For this assignment, we will examine our keras MNIST network, and try to optimize it. We will interface keras to scikit learn to do this, following the strategy outlined in the book.
For the extra credit, I want you to learn how to implement a simple model using the Keras Functional API.
Get both the test and train data from Keras.
As we did in the in-class work, use the "Train" sample to form a train and validation dataset. Keep the Test set separate and use it for final performance evaluation after training.
import tensorflow as tf
from tensorflow import keras
from sklearn.model_selection import train_test_split
import pandas as pd
import numpy as np
import plotly.express as px
import plotly.io as pio
import numpy as np
from collections import defaultdict
from functools import partial
from itertools import repeat
def nested_defaultdict(default_factory, depth=1):
result = partial(defaultdict, default_factory)
for _ in repeat(None, depth - 1):
result = partial(defaultdict, result)
return result()
pio.renderers.default='notebook'
print(tf.__version__)
print(keras.__version__)
2.6.0 2.6.0
(train_images, train_labels), (test_images, test_labels) = keras.datasets.mnist.load_data()
short = False
if short:
train_images = train_images[:7000,:]
train_labels = train_labels[:7000]
test_images = test_images[:3000,:]
test_labels = test_labels[:3000]
#
print("Train info",train_images.shape, train_labels.shape)
print("Test info",test_images.shape, test_labels.shape)
train_labels_cat = keras.utils.to_categorical(train_labels)
test_labels_cat = keras.utils.to_categorical(test_labels)
train_images_temp,val_images,train_labels_cat_temp,val_labels_cat = train_test_split(train_images,train_labels_cat, test_size=0.1, random_state=42)
Train info (60000, 28, 28) (60000,) Test info (10000, 28, 28) (10000,)
Use the version from the in-class workbook as a starting point.
However, you will want to add arguments for the following:
def build_model(n_hidden=2,n_neurons=100,optimizer='adam',activation='tanh',learning_rate=3e-3,input_shape=[28,28]):
model = keras.models.Sequential()
model.add(keras.layers.Flatten(input_shape=[28,28]))
for i in range(n_hidden):
model.add(keras.layers.Dense(n_neurons,activation=activation))
model.add(keras.layers.Dense(10,activation='softmax'))
model.compile(optimizer=optimizer,loss='categorical_crossentropy',metrics=['accuracy'])
return model
Follow the strategy on p.320-321 of the text. You will use a KerasClassifier instead of a KerasRegressor used in the text, but everything else is basically the same.
You will want to look at the following paremeters:
This will only take about 3-5 minutes.
from sklearn.model_selection import RandomizedSearchCV
import time
t0 = time.time()
params_distribs = {"n_hidden":[2,3],"activation":["tanh","relu"]}
#
# Your code goes here
keras_class = keras.wrappers.scikit_learn.KerasClassifier(build_model)
rnd_search_cv = RandomizedSearchCV(keras_class, params_distribs, n_iter=10,cv=3)
rnd_search_cv.fit(train_images_temp,train_labels_cat_temp,epochs=100,
validation_data=(val_images,val_labels_cat),
callbacks=[keras.callbacks.EarlyStopping(patience=10)])
print("Time to optimize: ",time.time()-t0)
Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.6637 - accuracy: 0.7907 - val_loss: 0.4802 - val_accuracy: 0.8450 Epoch 2/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4885 - accuracy: 0.8453 - val_loss: 0.4697 - val_accuracy: 0.8480 Epoch 3/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4417 - accuracy: 0.8575 - val_loss: 0.4014 - val_accuracy: 0.8758 Epoch 4/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3996 - accuracy: 0.8705 - val_loss: 0.3977 - val_accuracy: 0.8728 Epoch 5/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3777 - accuracy: 0.8789 - val_loss: 0.3549 - val_accuracy: 0.8855 Epoch 6/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3541 - accuracy: 0.8889 - val_loss: 0.3146 - val_accuracy: 0.8982 Epoch 7/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3339 - accuracy: 0.8932 - val_loss: 0.3322 - val_accuracy: 0.8958 Epoch 8/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3311 - accuracy: 0.8938 - val_loss: 0.3142 - val_accuracy: 0.8997 Epoch 9/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3163 - accuracy: 0.8987 - val_loss: 0.2975 - val_accuracy: 0.9057 Epoch 10/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3046 - accuracy: 0.9014 - val_loss: 0.2916 - val_accuracy: 0.9087 Epoch 11/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2837 - accuracy: 0.9099 - val_loss: 0.2565 - val_accuracy: 0.9188 Epoch 12/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2628 - accuracy: 0.9163 - val_loss: 0.2426 - val_accuracy: 0.9252 Epoch 13/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2668 - accuracy: 0.9143 - val_loss: 0.2449 - val_accuracy: 0.9238 Epoch 14/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2514 - accuracy: 0.9206 - val_loss: 0.2506 - val_accuracy: 0.9207 Epoch 15/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2500 - accuracy: 0.9217 - val_loss: 0.2455 - val_accuracy: 0.9220 Epoch 16/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2388 - accuracy: 0.9234 - val_loss: 0.2421 - val_accuracy: 0.9228 Epoch 17/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2304 - accuracy: 0.9268 - val_loss: 0.2431 - val_accuracy: 0.9248 Epoch 18/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2305 - accuracy: 0.9267 - val_loss: 0.2215 - val_accuracy: 0.9292 Epoch 19/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2229 - accuracy: 0.9287 - val_loss: 0.2285 - val_accuracy: 0.9288 Epoch 20/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2334 - accuracy: 0.9252 - val_loss: 0.2502 - val_accuracy: 0.9188 Epoch 21/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2424 - accuracy: 0.9227 - val_loss: 0.2375 - val_accuracy: 0.9220 Epoch 22/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2301 - accuracy: 0.9257 - val_loss: 0.2335 - val_accuracy: 0.9223 Epoch 23/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2257 - accuracy: 0.9262 - val_loss: 0.2435 - val_accuracy: 0.9235 Epoch 24/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2277 - accuracy: 0.9270 - val_loss: 0.2194 - val_accuracy: 0.9295 Epoch 25/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2173 - accuracy: 0.9313 - val_loss: 0.2306 - val_accuracy: 0.9280 Epoch 26/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2133 - accuracy: 0.9324 - val_loss: 0.2215 - val_accuracy: 0.9298 Epoch 27/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2067 - accuracy: 0.9345 - val_loss: 0.2185 - val_accuracy: 0.9315 Epoch 28/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2027 - accuracy: 0.9356 - val_loss: 0.2190 - val_accuracy: 0.9297 Epoch 29/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1976 - accuracy: 0.9360 - val_loss: 0.2231 - val_accuracy: 0.9300 Epoch 30/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2092 - accuracy: 0.9332 - val_loss: 0.2016 - val_accuracy: 0.9403 Epoch 31/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2039 - accuracy: 0.9331 - val_loss: 0.2160 - val_accuracy: 0.9310 Epoch 32/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2129 - accuracy: 0.9305 - val_loss: 0.2260 - val_accuracy: 0.9252 Epoch 33/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2091 - accuracy: 0.9319 - val_loss: 0.2289 - val_accuracy: 0.9280 Epoch 34/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2081 - accuracy: 0.9334 - val_loss: 0.2109 - val_accuracy: 0.9335 Epoch 35/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1989 - accuracy: 0.9376 - val_loss: 0.2008 - val_accuracy: 0.9350 Epoch 36/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1914 - accuracy: 0.9378 - val_loss: 0.2052 - val_accuracy: 0.9398 Epoch 37/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1870 - accuracy: 0.9397 - val_loss: 0.2186 - val_accuracy: 0.9360 Epoch 38/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1851 - accuracy: 0.9417 - val_loss: 0.2041 - val_accuracy: 0.9392 Epoch 39/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1749 - accuracy: 0.9459 - val_loss: 0.1934 - val_accuracy: 0.9385 Epoch 40/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1769 - accuracy: 0.9430 - val_loss: 0.1952 - val_accuracy: 0.9390 Epoch 41/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1767 - accuracy: 0.9427 - val_loss: 0.1810 - val_accuracy: 0.9428 Epoch 42/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1778 - accuracy: 0.9455 - val_loss: 0.1978 - val_accuracy: 0.9428 Epoch 43/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1734 - accuracy: 0.9447 - val_loss: 0.1802 - val_accuracy: 0.9468 Epoch 44/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1724 - accuracy: 0.9437 - val_loss: 0.1805 - val_accuracy: 0.9427 Epoch 45/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1737 - accuracy: 0.9449 - val_loss: 0.1743 - val_accuracy: 0.9457 Epoch 46/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1694 - accuracy: 0.9456 - val_loss: 0.1808 - val_accuracy: 0.9437 Epoch 47/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1748 - accuracy: 0.9444 - val_loss: 0.1919 - val_accuracy: 0.9420 Epoch 48/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1775 - accuracy: 0.9433 - val_loss: 0.1831 - val_accuracy: 0.9407 Epoch 49/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1628 - accuracy: 0.9481 - val_loss: 0.1801 - val_accuracy: 0.9460 Epoch 50/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1578 - accuracy: 0.9495 - val_loss: 0.1746 - val_accuracy: 0.9462 Epoch 51/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1607 - accuracy: 0.9482 - val_loss: 0.1725 - val_accuracy: 0.9447 Epoch 52/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1683 - accuracy: 0.9457 - val_loss: 0.1789 - val_accuracy: 0.9407 Epoch 53/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1620 - accuracy: 0.9474 - val_loss: 0.1813 - val_accuracy: 0.9432 Epoch 54/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1593 - accuracy: 0.9479 - val_loss: 0.1712 - val_accuracy: 0.9467 Epoch 55/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1587 - accuracy: 0.9487 - val_loss: 0.1682 - val_accuracy: 0.9487 Epoch 56/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1630 - accuracy: 0.9472 - val_loss: 0.1826 - val_accuracy: 0.9453 Epoch 57/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1611 - accuracy: 0.9471 - val_loss: 0.1768 - val_accuracy: 0.9460 Epoch 58/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1640 - accuracy: 0.9477 - val_loss: 0.1779 - val_accuracy: 0.9460 Epoch 59/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1568 - accuracy: 0.9494 - val_loss: 0.1767 - val_accuracy: 0.9495 Epoch 60/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1652 - accuracy: 0.9469 - val_loss: 0.1809 - val_accuracy: 0.9438 Epoch 61/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1660 - accuracy: 0.9473 - val_loss: 0.1941 - val_accuracy: 0.9388 Epoch 62/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1718 - accuracy: 0.9439 - val_loss: 0.1817 - val_accuracy: 0.9437 Epoch 63/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1642 - accuracy: 0.9475 - val_loss: 0.1738 - val_accuracy: 0.9460 Epoch 64/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1549 - accuracy: 0.9507 - val_loss: 0.1738 - val_accuracy: 0.9473 Epoch 65/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1584 - accuracy: 0.9489 - val_loss: 0.1912 - val_accuracy: 0.9415 563/563 [==============================] - 1s 1ms/step - loss: 0.1989 - accuracy: 0.9388 Epoch 1/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.6374 - accuracy: 0.8018 - val_loss: 0.4889 - val_accuracy: 0.8395 Epoch 2/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4548 - accuracy: 0.8558 - val_loss: 0.4613 - val_accuracy: 0.8497 Epoch 3/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4374 - accuracy: 0.8628 - val_loss: 0.3911 - val_accuracy: 0.8772 Epoch 4/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4023 - accuracy: 0.8712 - val_loss: 0.3710 - val_accuracy: 0.8828 Epoch 5/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3949 - accuracy: 0.8742 - val_loss: 0.3746 - val_accuracy: 0.8808 Epoch 6/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3733 - accuracy: 0.8800 - val_loss: 0.3455 - val_accuracy: 0.8895 Epoch 7/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3207 - accuracy: 0.8992 - val_loss: 0.3049 - val_accuracy: 0.9037 Epoch 8/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3152 - accuracy: 0.9013 - val_loss: 0.2837 - val_accuracy: 0.9107 Epoch 9/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3042 - accuracy: 0.9050 - val_loss: 0.2856 - val_accuracy: 0.9093 Epoch 10/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2995 - accuracy: 0.9059 - val_loss: 0.2948 - val_accuracy: 0.9040 Epoch 11/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2833 - accuracy: 0.9085 - val_loss: 0.2767 - val_accuracy: 0.9148 Epoch 12/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2767 - accuracy: 0.9135 - val_loss: 0.2653 - val_accuracy: 0.9172 Epoch 13/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2549 - accuracy: 0.9197 - val_loss: 0.2583 - val_accuracy: 0.9167 Epoch 14/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2590 - accuracy: 0.9164 - val_loss: 0.2741 - val_accuracy: 0.9127 Epoch 15/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2632 - accuracy: 0.9163 - val_loss: 0.2651 - val_accuracy: 0.9163 Epoch 16/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2604 - accuracy: 0.9182 - val_loss: 0.2582 - val_accuracy: 0.9217 Epoch 17/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2408 - accuracy: 0.9231 - val_loss: 0.2454 - val_accuracy: 0.9237 Epoch 18/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2473 - accuracy: 0.9216 - val_loss: 0.2568 - val_accuracy: 0.9167 Epoch 19/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2351 - accuracy: 0.9260 - val_loss: 0.2472 - val_accuracy: 0.9225 Epoch 20/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2384 - accuracy: 0.9241 - val_loss: 0.2416 - val_accuracy: 0.9247 Epoch 21/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2306 - accuracy: 0.9267 - val_loss: 0.2685 - val_accuracy: 0.9197 Epoch 22/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2285 - accuracy: 0.9264 - val_loss: 0.2491 - val_accuracy: 0.9230 Epoch 23/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2240 - accuracy: 0.9294 - val_loss: 0.2364 - val_accuracy: 0.9212 Epoch 24/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2356 - accuracy: 0.9248 - val_loss: 0.2392 - val_accuracy: 0.9230 Epoch 25/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2325 - accuracy: 0.9246 - val_loss: 0.2318 - val_accuracy: 0.9242 Epoch 26/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2263 - accuracy: 0.9281 - val_loss: 0.2551 - val_accuracy: 0.9165 Epoch 27/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2331 - accuracy: 0.9250 - val_loss: 0.2295 - val_accuracy: 0.9280 Epoch 28/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2267 - accuracy: 0.9270 - val_loss: 0.2106 - val_accuracy: 0.9353 Epoch 29/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2110 - accuracy: 0.9333 - val_loss: 0.2271 - val_accuracy: 0.9268 Epoch 30/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2090 - accuracy: 0.9336 - val_loss: 0.2180 - val_accuracy: 0.9352 Epoch 31/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2105 - accuracy: 0.9323 - val_loss: 0.2197 - val_accuracy: 0.9322 Epoch 32/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2205 - accuracy: 0.9308 - val_loss: 0.2252 - val_accuracy: 0.9307 Epoch 33/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2046 - accuracy: 0.9355 - val_loss: 0.2238 - val_accuracy: 0.9292 Epoch 34/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1973 - accuracy: 0.9369 - val_loss: 0.2137 - val_accuracy: 0.9325 Epoch 35/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1934 - accuracy: 0.9381 - val_loss: 0.2036 - val_accuracy: 0.9367 Epoch 36/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1957 - accuracy: 0.9375 - val_loss: 0.2015 - val_accuracy: 0.9360 Epoch 37/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2007 - accuracy: 0.9356 - val_loss: 0.2342 - val_accuracy: 0.9272 Epoch 38/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1956 - accuracy: 0.9363 - val_loss: 0.2011 - val_accuracy: 0.9362 Epoch 39/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1815 - accuracy: 0.9403 - val_loss: 0.2085 - val_accuracy: 0.9330 Epoch 40/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1873 - accuracy: 0.9381 - val_loss: 0.2030 - val_accuracy: 0.9373 Epoch 41/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1870 - accuracy: 0.9401 - val_loss: 0.1987 - val_accuracy: 0.9352 Epoch 42/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1834 - accuracy: 0.9406 - val_loss: 0.1915 - val_accuracy: 0.9385 Epoch 43/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1779 - accuracy: 0.9435 - val_loss: 0.1856 - val_accuracy: 0.9442 Epoch 44/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1773 - accuracy: 0.9428 - val_loss: 0.2076 - val_accuracy: 0.9350 Epoch 45/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1829 - accuracy: 0.9412 - val_loss: 0.1945 - val_accuracy: 0.9403 Epoch 46/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1799 - accuracy: 0.9406 - val_loss: 0.1851 - val_accuracy: 0.9422 Epoch 47/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1854 - accuracy: 0.9406 - val_loss: 0.2041 - val_accuracy: 0.9365 Epoch 48/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1812 - accuracy: 0.9415 - val_loss: 0.2018 - val_accuracy: 0.9382 Epoch 49/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1742 - accuracy: 0.9442 - val_loss: 0.1798 - val_accuracy: 0.9437 Epoch 50/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1730 - accuracy: 0.9441 - val_loss: 0.1888 - val_accuracy: 0.9425 Epoch 51/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1666 - accuracy: 0.9460 - val_loss: 0.1803 - val_accuracy: 0.9458 Epoch 52/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1624 - accuracy: 0.9481 - val_loss: 0.1820 - val_accuracy: 0.9420 Epoch 53/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1664 - accuracy: 0.9471 - val_loss: 0.1961 - val_accuracy: 0.9403 Epoch 54/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1605 - accuracy: 0.9494 - val_loss: 0.1925 - val_accuracy: 0.9412 Epoch 55/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1656 - accuracy: 0.9472 - val_loss: 0.1807 - val_accuracy: 0.9433 Epoch 56/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1709 - accuracy: 0.9454 - val_loss: 0.1890 - val_accuracy: 0.9397 Epoch 57/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1739 - accuracy: 0.9455 - val_loss: 0.1903 - val_accuracy: 0.9417 Epoch 58/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1745 - accuracy: 0.9438 - val_loss: 0.1974 - val_accuracy: 0.9405 Epoch 59/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1692 - accuracy: 0.9459 - val_loss: 0.1833 - val_accuracy: 0.9448 563/563 [==============================] - 1s 1ms/step - loss: 0.2062 - accuracy: 0.9361 Epoch 1/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.6393 - accuracy: 0.7986 - val_loss: 0.4932 - val_accuracy: 0.8455 Epoch 2/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4538 - accuracy: 0.8559 - val_loss: 0.4219 - val_accuracy: 0.8657 Epoch 3/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4250 - accuracy: 0.8637 - val_loss: 0.4275 - val_accuracy: 0.8598 Epoch 4/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3857 - accuracy: 0.8772 - val_loss: 0.3559 - val_accuracy: 0.8875 Epoch 5/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3578 - accuracy: 0.8874 - val_loss: 0.3432 - val_accuracy: 0.8902 Epoch 6/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3348 - accuracy: 0.8926 - val_loss: 0.3257 - val_accuracy: 0.8998 Epoch 7/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3184 - accuracy: 0.8993 - val_loss: 0.3095 - val_accuracy: 0.8955 Epoch 8/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3113 - accuracy: 0.9017 - val_loss: 0.2846 - val_accuracy: 0.9130 Epoch 9/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2937 - accuracy: 0.9056 - val_loss: 0.2902 - val_accuracy: 0.9097 Epoch 10/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2825 - accuracy: 0.9107 - val_loss: 0.2879 - val_accuracy: 0.9088 Epoch 11/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2905 - accuracy: 0.9068 - val_loss: 0.2951 - val_accuracy: 0.9028 Epoch 12/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2952 - accuracy: 0.9056 - val_loss: 0.2982 - val_accuracy: 0.9045 Epoch 13/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2943 - accuracy: 0.9049 - val_loss: 0.2684 - val_accuracy: 0.9123 Epoch 14/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2595 - accuracy: 0.9185 - val_loss: 0.2415 - val_accuracy: 0.9228 Epoch 15/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2528 - accuracy: 0.9206 - val_loss: 0.2488 - val_accuracy: 0.9207 Epoch 16/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2561 - accuracy: 0.9192 - val_loss: 0.2548 - val_accuracy: 0.9170 Epoch 17/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2563 - accuracy: 0.9174 - val_loss: 0.2609 - val_accuracy: 0.9158 Epoch 18/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2499 - accuracy: 0.9205 - val_loss: 0.2408 - val_accuracy: 0.9233 Epoch 19/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2390 - accuracy: 0.9245 - val_loss: 0.2432 - val_accuracy: 0.9252 Epoch 20/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2422 - accuracy: 0.9227 - val_loss: 0.2506 - val_accuracy: 0.9198 Epoch 21/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2413 - accuracy: 0.9220 - val_loss: 0.2522 - val_accuracy: 0.9205 Epoch 22/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2388 - accuracy: 0.9234 - val_loss: 0.2542 - val_accuracy: 0.9208 Epoch 23/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2310 - accuracy: 0.9261 - val_loss: 0.2284 - val_accuracy: 0.9308 Epoch 24/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1788 - accuracy: 0.9440 - val_loss: 0.1839 - val_accuracy: 0.9430 Epoch 48/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1788 - accuracy: 0.9433 - val_loss: 0.1837 - val_accuracy: 0.9415 Epoch 49/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1760 - accuracy: 0.9436 - val_loss: 0.1976 - val_accuracy: 0.9370 Epoch 50/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1875 - accuracy: 0.9386 - val_loss: 0.2031 - val_accuracy: 0.9345 Epoch 51/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1804 - accuracy: 0.9417 - val_loss: 0.1934 - val_accuracy: 0.9370 Epoch 52/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1870 - accuracy: 0.9394 - val_loss: 0.2259 - val_accuracy: 0.9263 Epoch 53/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1933 - accuracy: 0.9374 - val_loss: 0.2101 - val_accuracy: 0.9318 Epoch 54/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1895 - accuracy: 0.9383 - val_loss: 0.2018 - val_accuracy: 0.9358 Epoch 55/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1870 - accuracy: 0.9392 - val_loss: 0.2055 - val_accuracy: 0.9372 Epoch 56/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1929 - accuracy: 0.9370 - val_loss: 0.2084 - val_accuracy: 0.9352 Epoch 57/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1845 - accuracy: 0.9404 - val_loss: 0.2004 - val_accuracy: 0.9377 Epoch 58/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1869 - accuracy: 0.9390 - val_loss: 0.2219 - val_accuracy: 0.9278 563/563 [==============================] - 1s 1ms/step - loss: 0.2285 - accuracy: 0.9298 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.6307 - accuracy: 0.7978 - val_loss: 0.5267 - val_accuracy: 0.8285 Epoch 2/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.4767 - accuracy: 0.8464 - val_loss: 0.4767 - val_accuracy: 0.8425 Epoch 3/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.4373 - accuracy: 0.8576 - val_loss: 0.3970 - val_accuracy: 0.8783 Epoch 4/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.4208 - accuracy: 0.8612 - val_loss: 0.4298 - val_accuracy: 0.8562 Epoch 5/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3592 - accuracy: 0.8843 - val_loss: 0.3290 - val_accuracy: 0.8953 Epoch 6/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3822 - accuracy: 0.8769 - val_loss: 0.3826 - val_accuracy: 0.8743 Epoch 7/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3592 - accuracy: 0.8835 - val_loss: 0.3354 - val_accuracy: 0.8913 Epoch 8/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3272 - accuracy: 0.8943 - val_loss: 0.2978 - val_accuracy: 0.9048 Epoch 9/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3180 - accuracy: 0.8972 - val_loss: 0.3058 - val_accuracy: 0.9017 Epoch 10/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3164 - accuracy: 0.8973 - val_loss: 0.3188 - val_accuracy: 0.8990 Epoch 11/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3067 - accuracy: 0.8998 - val_loss: 0.2995 - val_accuracy: 0.9030 Epoch 12/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2838 - accuracy: 0.9087 - val_loss: 0.2693 - val_accuracy: 0.9155 Epoch 13/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2666 - accuracy: 0.9152 - val_loss: 0.2546 - val_accuracy: 0.9230 Epoch 14/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2613 - accuracy: 0.9153 - val_loss: 0.2725 - val_accuracy: 0.9150 Epoch 15/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2475 - accuracy: 0.9209 - val_loss: 0.2494 - val_accuracy: 0.9207 Epoch 16/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2427 - accuracy: 0.9218 - val_loss: 0.2574 - val_accuracy: 0.9208 Epoch 17/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2436 - accuracy: 0.9221 - val_loss: 0.2530 - val_accuracy: 0.9198 Epoch 18/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2415 - accuracy: 0.9245 - val_loss: 0.2335 - val_accuracy: 0.9278 Epoch 19/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2632 - accuracy: 0.9155 - val_loss: 0.2671 - val_accuracy: 0.9130 Epoch 20/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2689 - accuracy: 0.9151 - val_loss: 0.2853 - val_accuracy: 0.9073 Epoch 21/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2728 - accuracy: 0.9108 - val_loss: 0.2790 - val_accuracy: 0.9087 Epoch 22/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2699 - accuracy: 0.9113 - val_loss: 0.2712 - val_accuracy: 0.9135 Epoch 23/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2586 - accuracy: 0.9147 - val_loss: 0.2465 - val_accuracy: 0.9225 Epoch 24/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2444 - accuracy: 0.9216 - val_loss: 0.2529 - val_accuracy: 0.9217 Epoch 25/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2502 - accuracy: 0.9184 - val_loss: 0.2436 - val_accuracy: 0.9223 Epoch 26/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2351 - accuracy: 0.9262 - val_loss: 0.2309 - val_accuracy: 0.9287 Epoch 27/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2121 - accuracy: 0.9337 - val_loss: 0.2219 - val_accuracy: 0.9303 Epoch 28/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2157 - accuracy: 0.9310 - val_loss: 0.2229 - val_accuracy: 0.9292 Epoch 29/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2201 - accuracy: 0.9291 - val_loss: 0.2082 - val_accuracy: 0.9372 Epoch 30/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2079 - accuracy: 0.9331 - val_loss: 0.2389 - val_accuracy: 0.9215 Epoch 31/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2074 - accuracy: 0.9320 - val_loss: 0.2192 - val_accuracy: 0.9310 Epoch 32/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2117 - accuracy: 0.9313 - val_loss: 0.2070 - val_accuracy: 0.9357 Epoch 33/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2142 - accuracy: 0.9302 - val_loss: 0.2223 - val_accuracy: 0.9273 Epoch 34/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2086 - accuracy: 0.9319 - val_loss: 0.2206 - val_accuracy: 0.9308 Epoch 35/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2015 - accuracy: 0.9356 - val_loss: 0.2273 - val_accuracy: 0.9282 Epoch 36/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2077 - accuracy: 0.9331 - val_loss: 0.2155 - val_accuracy: 0.9327 Epoch 37/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2010 - accuracy: 0.9357 - val_loss: 0.2226 - val_accuracy: 0.9315 Epoch 38/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2147 - accuracy: 0.9306 - val_loss: 0.2333 - val_accuracy: 0.9273 Epoch 39/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2150 - accuracy: 0.9290 - val_loss: 0.2429 - val_accuracy: 0.9267 Epoch 40/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2165 - accuracy: 0.9290 - val_loss: 0.2408 - val_accuracy: 0.9275 Epoch 41/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2275 - accuracy: 0.9254 - val_loss: 0.2447 - val_accuracy: 0.9253 Epoch 42/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2202 - accuracy: 0.9288 - val_loss: 0.2342 - val_accuracy: 0.9293 563/563 [==============================] - 1s 2ms/step - loss: 0.2364 - accuracy: 0.9277 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.6448 - accuracy: 0.7921 - val_loss: 0.5028 - val_accuracy: 0.8348 Epoch 2/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.4838 - accuracy: 0.8416 - val_loss: 0.4509 - val_accuracy: 0.8500 Epoch 3/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.4194 - accuracy: 0.8651 - val_loss: 0.3621 - val_accuracy: 0.8788 Epoch 4/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3802 - accuracy: 0.8757 - val_loss: 0.3499 - val_accuracy: 0.8873 Epoch 5/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3502 - accuracy: 0.8857 - val_loss: 0.3321 - val_accuracy: 0.8962 Epoch 6/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3362 - accuracy: 0.8906 - val_loss: 0.3612 - val_accuracy: 0.8808 Epoch 7/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3548 - accuracy: 0.8844 - val_loss: 0.3591 - val_accuracy: 0.8813 Epoch 8/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3330 - accuracy: 0.8914 - val_loss: 0.3325 - val_accuracy: 0.8970 Epoch 9/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3343 - accuracy: 0.8918 - val_loss: 0.3216 - val_accuracy: 0.8937 Epoch 10/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3303 - accuracy: 0.8927 - val_loss: 0.3020 - val_accuracy: 0.9010 Epoch 11/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2899 - accuracy: 0.9071 - val_loss: 0.2914 - val_accuracy: 0.9080 Epoch 12/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2917 - accuracy: 0.9067 - val_loss: 0.3185 - val_accuracy: 0.8963 Epoch 13/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2964 - accuracy: 0.9044 - val_loss: 0.3018 - val_accuracy: 0.9067 Epoch 14/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2809 - accuracy: 0.9104 - val_loss: 0.2900 - val_accuracy: 0.9080 Epoch 15/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2690 - accuracy: 0.9149 - val_loss: 0.2796 - val_accuracy: 0.9095 Epoch 16/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2752 - accuracy: 0.9112 - val_loss: 0.2828 - val_accuracy: 0.9100 Epoch 17/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2533 - accuracy: 0.9169 - val_loss: 0.2586 - val_accuracy: 0.9138 Epoch 18/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2468 - accuracy: 0.9211 - val_loss: 0.2469 - val_accuracy: 0.9203 Epoch 19/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2477 - accuracy: 0.9201 - val_loss: 0.2500 - val_accuracy: 0.9195 Epoch 20/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2604 - accuracy: 0.9157 - val_loss: 0.2465 - val_accuracy: 0.9217 Epoch 21/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2538 - accuracy: 0.9184 - val_loss: 0.2748 - val_accuracy: 0.9148 Epoch 22/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2445 - accuracy: 0.9221 - val_loss: 0.2577 - val_accuracy: 0.9188 Epoch 23/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2383 - accuracy: 0.9243 - val_loss: 0.2377 - val_accuracy: 0.9238 Epoch 24/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2155 - accuracy: 0.9321 - val_loss: 0.2109 - val_accuracy: 0.9370 Epoch 25/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2160 - accuracy: 0.9313 - val_loss: 0.2413 - val_accuracy: 0.9230 Epoch 26/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2123 - accuracy: 0.9318 - val_loss: 0.2275 - val_accuracy: 0.9317 Epoch 27/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2098 - accuracy: 0.9336 - val_loss: 0.2263 - val_accuracy: 0.9265 Epoch 28/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2214 - accuracy: 0.9296 - val_loss: 0.2277 - val_accuracy: 0.9245 Epoch 29/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2173 - accuracy: 0.9302 - val_loss: 0.2109 - val_accuracy: 0.9330 Epoch 30/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2074 - accuracy: 0.9333 - val_loss: 0.2117 - val_accuracy: 0.9332 Epoch 31/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1999 - accuracy: 0.9358 - val_loss: 0.2164 - val_accuracy: 0.9287 Epoch 32/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2119 - accuracy: 0.9310 - val_loss: 0.2227 - val_accuracy: 0.9313 Epoch 33/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2105 - accuracy: 0.9326 - val_loss: 0.2113 - val_accuracy: 0.9337 Epoch 34/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2087 - accuracy: 0.9330 - val_loss: 0.2162 - val_accuracy: 0.9355 563/563 [==============================] - 1s 2ms/step - loss: 0.2239 - accuracy: 0.9290 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.6366 - accuracy: 0.7946 - val_loss: 0.5462 - val_accuracy: 0.8272 Epoch 2/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.4777 - accuracy: 0.8439 - val_loss: 0.4137 - val_accuracy: 0.8682 Epoch 3/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.4063 - accuracy: 0.8681 - val_loss: 0.3568 - val_accuracy: 0.8830 Epoch 4/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3981 - accuracy: 0.8715 - val_loss: 0.3739 - val_accuracy: 0.8763 Epoch 5/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3807 - accuracy: 0.8769 - val_loss: 0.3826 - val_accuracy: 0.8760 Epoch 6/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3567 - accuracy: 0.8843 - val_loss: 0.3235 - val_accuracy: 0.8968 Epoch 7/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3419 - accuracy: 0.8886 - val_loss: 0.3042 - val_accuracy: 0.9005 Epoch 8/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3329 - accuracy: 0.8940 - val_loss: 0.3306 - val_accuracy: 0.8935 Epoch 9/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3232 - accuracy: 0.8944 - val_loss: 0.3035 - val_accuracy: 0.9032 Epoch 10/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2883 - accuracy: 0.9066 - val_loss: 0.2890 - val_accuracy: 0.9092 Epoch 11/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2981 - accuracy: 0.9018 - val_loss: 0.2968 - val_accuracy: 0.9072 Epoch 12/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2870 - accuracy: 0.9053 - val_loss: 0.2933 - val_accuracy: 0.9053 Epoch 13/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2792 - accuracy: 0.9099 - val_loss: 0.2776 - val_accuracy: 0.9090 Epoch 14/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2634 - accuracy: 0.9162 - val_loss: 0.2517 - val_accuracy: 0.9187 Epoch 15/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2619 - accuracy: 0.9149 - val_loss: 0.2858 - val_accuracy: 0.9083 Epoch 16/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2633 - accuracy: 0.9167 - val_loss: 0.2496 - val_accuracy: 0.9202 Epoch 17/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2581 - accuracy: 0.9163 - val_loss: 0.2487 - val_accuracy: 0.9213 Epoch 18/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2594 - accuracy: 0.9175 - val_loss: 0.2530 - val_accuracy: 0.9200 Epoch 19/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2555 - accuracy: 0.9173 - val_loss: 0.2651 - val_accuracy: 0.9185 Epoch 20/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2537 - accuracy: 0.9177 - val_loss: 0.2510 - val_accuracy: 0.9203 Epoch 21/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2410 - accuracy: 0.9230 - val_loss: 0.2274 - val_accuracy: 0.9263 Epoch 22/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2358 - accuracy: 0.9240 - val_loss: 0.2527 - val_accuracy: 0.9215 Epoch 23/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2332 - accuracy: 0.9254 - val_loss: 0.2595 - val_accuracy: 0.9118 Epoch 24/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2332 - accuracy: 0.9232 - val_loss: 0.2473 - val_accuracy: 0.9213 Epoch 25/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2326 - accuracy: 0.9248 - val_loss: 0.2395 - val_accuracy: 0.9245 Epoch 26/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2118 - accuracy: 0.9320 - val_loss: 0.2215 - val_accuracy: 0.9338 Epoch 27/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2133 - accuracy: 0.9315 - val_loss: 0.2258 - val_accuracy: 0.9290 Epoch 28/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2168 - accuracy: 0.9296 - val_loss: 0.2385 - val_accuracy: 0.9263 Epoch 29/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2264 - accuracy: 0.9268 - val_loss: 0.2621 - val_accuracy: 0.9157 Epoch 30/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2271 - accuracy: 0.9279 - val_loss: 0.2447 - val_accuracy: 0.9217 Epoch 31/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2197 - accuracy: 0.9304 - val_loss: 0.2237 - val_accuracy: 0.9278 Epoch 32/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2177 - accuracy: 0.9295 - val_loss: 0.2320 - val_accuracy: 0.9262 Epoch 33/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2032 - accuracy: 0.9348 - val_loss: 0.2120 - val_accuracy: 0.9337 Epoch 34/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2017 - accuracy: 0.9349 - val_loss: 0.2242 - val_accuracy: 0.9297 Epoch 35/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1985 - accuracy: 0.9370 - val_loss: 0.2180 - val_accuracy: 0.9322 Epoch 36/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2016 - accuracy: 0.9339 - val_loss: 0.2030 - val_accuracy: 0.9372 Epoch 37/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2036 - accuracy: 0.9337 - val_loss: 0.2282 - val_accuracy: 0.9302 Epoch 38/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2064 - accuracy: 0.9337 - val_loss: 0.2410 - val_accuracy: 0.9270 Epoch 39/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2056 - accuracy: 0.9352 - val_loss: 0.2253 - val_accuracy: 0.9348 Epoch 40/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1931 - accuracy: 0.9387 - val_loss: 0.2236 - val_accuracy: 0.9317 Epoch 41/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1799 - accuracy: 0.9434 - val_loss: 0.1828 - val_accuracy: 0.9442 Epoch 42/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1869 - accuracy: 0.9414 - val_loss: 0.2145 - val_accuracy: 0.9347 Epoch 43/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1886 - accuracy: 0.9415 - val_loss: 0.2042 - val_accuracy: 0.9372 Epoch 44/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1767 - accuracy: 0.9446 - val_loss: 0.1972 - val_accuracy: 0.9355 Epoch 45/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1870 - accuracy: 0.9402 - val_loss: 0.2129 - val_accuracy: 0.9342 Epoch 46/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1839 - accuracy: 0.9403 - val_loss: 0.1993 - val_accuracy: 0.9377 Epoch 47/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1736 - accuracy: 0.9449 - val_loss: 0.2006 - val_accuracy: 0.9375 Epoch 48/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1694 - accuracy: 0.9458 - val_loss: 0.2024 - val_accuracy: 0.9422 Epoch 49/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1725 - accuracy: 0.9450 - val_loss: 0.1962 - val_accuracy: 0.9373 Epoch 50/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1731 - accuracy: 0.9452 - val_loss: 0.2030 - val_accuracy: 0.9390 Epoch 51/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1713 - accuracy: 0.9435 - val_loss: 0.1971 - val_accuracy: 0.9370 563/563 [==============================] - 1s 2ms/step - loss: 0.2170 - accuracy: 0.9337 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 2.4496 - accuracy: 0.8463 - val_loss: 0.8008 - val_accuracy: 0.8913 Epoch 2/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.5851 - accuracy: 0.9066 - val_loss: 0.4436 - val_accuracy: 0.9230 Epoch 3/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3769 - accuracy: 0.9263 - val_loss: 0.4285 - val_accuracy: 0.9333 Epoch 4/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3056 - accuracy: 0.9360 - val_loss: 0.3845 - val_accuracy: 0.9215 Epoch 5/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2565 - accuracy: 0.9418 - val_loss: 0.3130 - val_accuracy: 0.9420 Epoch 6/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2104 - accuracy: 0.9487 - val_loss: 0.3014 - val_accuracy: 0.9435 Epoch 7/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1981 - accuracy: 0.9517 - val_loss: 0.2591 - val_accuracy: 0.9442 Epoch 8/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1583 - accuracy: 0.9585 - val_loss: 0.2400 - val_accuracy: 0.9438 Epoch 9/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1387 - accuracy: 0.9621 - val_loss: 0.2735 - val_accuracy: 0.9425 Epoch 10/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1228 - accuracy: 0.9645 - val_loss: 0.1807 - val_accuracy: 0.9578 Epoch 11/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1109 - accuracy: 0.9681 - val_loss: 0.1839 - val_accuracy: 0.9575 Epoch 12/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1099 - accuracy: 0.9692 - val_loss: 0.1997 - val_accuracy: 0.9575 Epoch 13/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0978 - accuracy: 0.9718 - val_loss: 0.2338 - val_accuracy: 0.9528 Epoch 14/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0944 - accuracy: 0.9734 - val_loss: 0.1979 - val_accuracy: 0.9578 Epoch 15/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0839 - accuracy: 0.9766 - val_loss: 0.2147 - val_accuracy: 0.9555 Epoch 16/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0788 - accuracy: 0.9783 - val_loss: 0.2134 - val_accuracy: 0.9610 Epoch 17/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0834 - accuracy: 0.9771 - val_loss: 0.2007 - val_accuracy: 0.9638 Epoch 18/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0787 - accuracy: 0.9796 - val_loss: 0.2104 - val_accuracy: 0.9600 Epoch 19/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0804 - accuracy: 0.9795 - val_loss: 0.2252 - val_accuracy: 0.9573 Epoch 20/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0626 - accuracy: 0.9832 - val_loss: 0.2033 - val_accuracy: 0.9605 563/563 [==============================] - 1s 2ms/step - loss: 0.2249 - accuracy: 0.9589 Epoch 1/100 1125/1125 [==============================] - 3s 3ms/step - loss: 2.5964 - accuracy: 0.8410 - val_loss: 0.7319 - val_accuracy: 0.8867 Epoch 2/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4862 - accuracy: 0.9062 - val_loss: 0.4985 - val_accuracy: 0.8950 Epoch 3/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3415 - accuracy: 0.9258 - val_loss: 0.3780 - val_accuracy: 0.9262 Epoch 4/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2896 - accuracy: 0.9336 - val_loss: 0.3461 - val_accuracy: 0.9353 Epoch 5/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2397 - accuracy: 0.9422 - val_loss: 0.3350 - val_accuracy: 0.9297 Epoch 6/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2069 - accuracy: 0.9477 - val_loss: 0.2403 - val_accuracy: 0.9450 Epoch 7/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1737 - accuracy: 0.9554 - val_loss: 0.2491 - val_accuracy: 0.9423 Epoch 8/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1452 - accuracy: 0.9596 - val_loss: 0.1883 - val_accuracy: 0.9558 Epoch 9/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1303 - accuracy: 0.9641 - val_loss: 0.2368 - val_accuracy: 0.9455 Epoch 10/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1137 - accuracy: 0.9669 - val_loss: 0.1814 - val_accuracy: 0.9562 Epoch 11/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1098 - accuracy: 0.9690 - val_loss: 0.1848 - val_accuracy: 0.9580 Epoch 12/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1058 - accuracy: 0.9698 - val_loss: 0.1866 - val_accuracy: 0.9552 Epoch 13/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0965 - accuracy: 0.9722 - val_loss: 0.1846 - val_accuracy: 0.9545 Epoch 14/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0882 - accuracy: 0.9741 - val_loss: 0.1544 - val_accuracy: 0.9625 Epoch 15/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0753 - accuracy: 0.9778 - val_loss: 0.2092 - val_accuracy: 0.9627 Epoch 16/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0889 - accuracy: 0.9762 - val_loss: 0.2626 - val_accuracy: 0.9520 Epoch 17/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0768 - accuracy: 0.9792 - val_loss: 0.2136 - val_accuracy: 0.9597 Epoch 18/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0798 - accuracy: 0.9778 - val_loss: 0.2096 - val_accuracy: 0.9610 Epoch 19/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0639 - accuracy: 0.9821 - val_loss: 0.1944 - val_accuracy: 0.9622 Epoch 20/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0750 - accuracy: 0.9791 - val_loss: 0.1899 - val_accuracy: 0.9603 Epoch 21/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0638 - accuracy: 0.9824 - val_loss: 0.1977 - val_accuracy: 0.9650 Epoch 22/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0681 - accuracy: 0.9813 - val_loss: 0.2199 - val_accuracy: 0.9627 Epoch 23/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0644 - accuracy: 0.9823 - val_loss: 0.2279 - val_accuracy: 0.9627 Epoch 24/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0618 - accuracy: 0.9829 - val_loss: 0.2059 - val_accuracy: 0.9632 563/563 [==============================] - 1s 1ms/step - loss: 0.2708 - accuracy: 0.9580 Epoch 1/100 1125/1125 [==============================] - 3s 3ms/step - loss: 2.3470 - accuracy: 0.8414 - val_loss: 0.5355 - val_accuracy: 0.8988 Epoch 2/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.4377 - accuracy: 0.9134 - val_loss: 0.3670 - val_accuracy: 0.9243 Epoch 3/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.3012 - accuracy: 0.9314 - val_loss: 0.3290 - val_accuracy: 0.9248 Epoch 4/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.2385 - accuracy: 0.9407 - val_loss: 0.2994 - val_accuracy: 0.9292 Epoch 5/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1998 - accuracy: 0.9474 - val_loss: 0.2091 - val_accuracy: 0.9510 Epoch 6/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1767 - accuracy: 0.9534 - val_loss: 0.2367 - val_accuracy: 0.9435 Epoch 7/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1503 - accuracy: 0.9586 - val_loss: 0.2035 - val_accuracy: 0.9442 Epoch 8/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1392 - accuracy: 0.9622 - val_loss: 0.2158 - val_accuracy: 0.9400 Epoch 9/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1213 - accuracy: 0.9666 - val_loss: 0.1601 - val_accuracy: 0.9570 Epoch 10/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1094 - accuracy: 0.9688 - val_loss: 0.2030 - val_accuracy: 0.9495 Epoch 11/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.1091 - accuracy: 0.9702 - val_loss: 0.1719 - val_accuracy: 0.9587 Epoch 12/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0994 - accuracy: 0.9707 - val_loss: 0.1744 - val_accuracy: 0.9613 Epoch 13/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0934 - accuracy: 0.9747 - val_loss: 0.1694 - val_accuracy: 0.9563 Epoch 14/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0928 - accuracy: 0.9746 - val_loss: 0.1795 - val_accuracy: 0.9578 Epoch 15/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0881 - accuracy: 0.9747 - val_loss: 0.1855 - val_accuracy: 0.9610 Epoch 16/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0796 - accuracy: 0.9777 - val_loss: 0.1924 - val_accuracy: 0.9588 Epoch 17/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0794 - accuracy: 0.9788 - val_loss: 0.2097 - val_accuracy: 0.9587 Epoch 18/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0743 - accuracy: 0.9793 - val_loss: 0.1779 - val_accuracy: 0.9642 Epoch 19/100 1125/1125 [==============================] - 3s 2ms/step - loss: 0.0683 - accuracy: 0.9811 - val_loss: 0.2247 - val_accuracy: 0.9590 563/563 [==============================] - 1s 1ms/step - loss: 0.2461 - accuracy: 0.9552 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 1.2946 - accuracy: 0.8341 - val_loss: 0.3831 - val_accuracy: 0.9078 Epoch 2/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2862 - accuracy: 0.9237 - val_loss: 0.2577 - val_accuracy: 0.9313 Epoch 3/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2118 - accuracy: 0.9424 - val_loss: 0.2248 - val_accuracy: 0.9395 Epoch 4/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1684 - accuracy: 0.9512 - val_loss: 0.2144 - val_accuracy: 0.9407 Epoch 5/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1456 - accuracy: 0.9577 - val_loss: 0.1784 - val_accuracy: 0.9515 Epoch 6/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1289 - accuracy: 0.9607 - val_loss: 0.1808 - val_accuracy: 0.9537 Epoch 7/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1131 - accuracy: 0.9660 - val_loss: 0.1644 - val_accuracy: 0.9583 Epoch 8/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1005 - accuracy: 0.9704 - val_loss: 0.1470 - val_accuracy: 0.9620 Epoch 9/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0937 - accuracy: 0.9721 - val_loss: 0.1676 - val_accuracy: 0.9567 Epoch 10/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0823 - accuracy: 0.9764 - val_loss: 0.1378 - val_accuracy: 0.9670 Epoch 11/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0775 - accuracy: 0.9776 - val_loss: 0.1611 - val_accuracy: 0.9593 Epoch 12/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0689 - accuracy: 0.9794 - val_loss: 0.1746 - val_accuracy: 0.9615 Epoch 13/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0751 - accuracy: 0.9783 - val_loss: 0.1493 - val_accuracy: 0.9633 Epoch 14/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0644 - accuracy: 0.9811 - val_loss: 0.1500 - val_accuracy: 0.9670 Epoch 15/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0683 - accuracy: 0.9799 - val_loss: 0.1418 - val_accuracy: 0.9655 Epoch 16/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0561 - accuracy: 0.9837 - val_loss: 0.1461 - val_accuracy: 0.9672 Epoch 17/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0543 - accuracy: 0.9848 - val_loss: 0.1601 - val_accuracy: 0.9670 Epoch 18/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0523 - accuracy: 0.9854 - val_loss: 0.1675 - val_accuracy: 0.9677 Epoch 19/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0526 - accuracy: 0.9858 - val_loss: 0.1566 - val_accuracy: 0.9688 Epoch 20/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0522 - accuracy: 0.9854 - val_loss: 0.1724 - val_accuracy: 0.9693 563/563 [==============================] - 1s 2ms/step - loss: 0.2011 - accuracy: 0.9640 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 1.4961 - accuracy: 0.8439 - val_loss: 0.4219 - val_accuracy: 0.9063 Epoch 2/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3197 - accuracy: 0.9200 - val_loss: 0.3394 - val_accuracy: 0.9208 Epoch 3/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2395 - accuracy: 0.9367 - val_loss: 0.2710 - val_accuracy: 0.9328 Epoch 4/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2076 - accuracy: 0.9428 - val_loss: 0.2595 - val_accuracy: 0.9323 Epoch 5/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1686 - accuracy: 0.9511 - val_loss: 0.2001 - val_accuracy: 0.9460 Epoch 6/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1420 - accuracy: 0.9585 - val_loss: 0.2172 - val_accuracy: 0.9423 Epoch 7/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1330 - accuracy: 0.9611 - val_loss: 0.1960 - val_accuracy: 0.9500 Epoch 8/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1082 - accuracy: 0.9676 - val_loss: 0.1406 - val_accuracy: 0.9635 Epoch 9/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1018 - accuracy: 0.9705 - val_loss: 0.1630 - val_accuracy: 0.9598 Epoch 10/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0948 - accuracy: 0.9727 - val_loss: 0.1601 - val_accuracy: 0.9620 Epoch 11/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0903 - accuracy: 0.9739 - val_loss: 0.1457 - val_accuracy: 0.9622 Epoch 12/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0771 - accuracy: 0.9769 - val_loss: 0.1817 - val_accuracy: 0.9567 Epoch 13/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0698 - accuracy: 0.9799 - val_loss: 0.1680 - val_accuracy: 0.9632 Epoch 14/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0758 - accuracy: 0.9789 - val_loss: 0.1727 - val_accuracy: 0.9598 Epoch 15/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0686 - accuracy: 0.9799 - val_loss: 0.1666 - val_accuracy: 0.9663 Epoch 16/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0679 - accuracy: 0.9811 - val_loss: 0.1844 - val_accuracy: 0.9592 Epoch 17/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0651 - accuracy: 0.9816 - val_loss: 0.1690 - val_accuracy: 0.9663 Epoch 18/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0576 - accuracy: 0.9847 - val_loss: 0.1850 - val_accuracy: 0.9672 563/563 [==============================] - 1s 2ms/step - loss: 0.2068 - accuracy: 0.9639 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 1.4355 - accuracy: 0.8351 - val_loss: 0.3928 - val_accuracy: 0.9065 Epoch 2/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.3044 - accuracy: 0.9223 - val_loss: 0.2959 - val_accuracy: 0.9270 Epoch 3/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.2148 - accuracy: 0.9412 - val_loss: 0.2460 - val_accuracy: 0.9335 Epoch 4/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1892 - accuracy: 0.9472 - val_loss: 0.1981 - val_accuracy: 0.9447 Epoch 5/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1632 - accuracy: 0.9541 - val_loss: 0.1749 - val_accuracy: 0.9543 Epoch 6/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1444 - accuracy: 0.9580 - val_loss: 0.2005 - val_accuracy: 0.9440 Epoch 7/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1312 - accuracy: 0.9625 - val_loss: 0.1599 - val_accuracy: 0.9597 Epoch 8/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1120 - accuracy: 0.9678 - val_loss: 0.1705 - val_accuracy: 0.9515 Epoch 9/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.1083 - accuracy: 0.9684 - val_loss: 0.1611 - val_accuracy: 0.9557 Epoch 10/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0942 - accuracy: 0.9728 - val_loss: 0.1599 - val_accuracy: 0.9535 Epoch 11/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0929 - accuracy: 0.9737 - val_loss: 0.1525 - val_accuracy: 0.9587 Epoch 12/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0823 - accuracy: 0.9771 - val_loss: 0.1526 - val_accuracy: 0.9645 Epoch 13/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0773 - accuracy: 0.9782 - val_loss: 0.1935 - val_accuracy: 0.9585 Epoch 14/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0737 - accuracy: 0.9789 - val_loss: 0.1618 - val_accuracy: 0.9592 Epoch 15/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0715 - accuracy: 0.9797 - val_loss: 0.1660 - val_accuracy: 0.9632 Epoch 16/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0630 - accuracy: 0.9824 - val_loss: 0.1537 - val_accuracy: 0.9638 Epoch 17/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0578 - accuracy: 0.9833 - val_loss: 0.1740 - val_accuracy: 0.9640 Epoch 18/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0580 - accuracy: 0.9839 - val_loss: 0.1820 - val_accuracy: 0.9613 Epoch 19/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0604 - accuracy: 0.9829 - val_loss: 0.2073 - val_accuracy: 0.9595 Epoch 20/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0573 - accuracy: 0.9851 - val_loss: 0.1944 - val_accuracy: 0.9638 Epoch 21/100 1125/1125 [==============================] - 3s 3ms/step - loss: 0.0532 - accuracy: 0.9856 - val_loss: 0.1567 - val_accuracy: 0.9655 563/563 [==============================] - 1s 2ms/step - loss: 0.2063 - accuracy: 0.9629 Epoch 1/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.9621 - accuracy: 0.8628 - val_loss: 0.3214 - val_accuracy: 0.9120 Epoch 2/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.2626 - accuracy: 0.9298 - val_loss: 0.2274 - val_accuracy: 0.9383 Epoch 3/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.1932 - accuracy: 0.9461 - val_loss: 0.2076 - val_accuracy: 0.9465 Epoch 4/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.1586 - accuracy: 0.9543 - val_loss: 0.1573 - val_accuracy: 0.9580 Epoch 5/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.1341 - accuracy: 0.9610 - val_loss: 0.1381 - val_accuracy: 0.9623 Epoch 6/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.1201 - accuracy: 0.9646 - val_loss: 0.1320 - val_accuracy: 0.9637 Epoch 7/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.1091 - accuracy: 0.9677 - val_loss: 0.1517 - val_accuracy: 0.9627 Epoch 8/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0979 - accuracy: 0.9721 - val_loss: 0.1349 - val_accuracy: 0.9648 Epoch 9/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0891 - accuracy: 0.9746 - val_loss: 0.1311 - val_accuracy: 0.9653 Epoch 10/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0845 - accuracy: 0.9763 - val_loss: 0.1570 - val_accuracy: 0.9628 Epoch 11/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0780 - accuracy: 0.9772 - val_loss: 0.1440 - val_accuracy: 0.9685 Epoch 12/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0753 - accuracy: 0.9792 - val_loss: 0.1433 - val_accuracy: 0.9708 Epoch 13/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0698 - accuracy: 0.9804 - val_loss: 0.1567 - val_accuracy: 0.9618 Epoch 14/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0679 - accuracy: 0.9814 - val_loss: 0.1660 - val_accuracy: 0.9620 Epoch 15/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0655 - accuracy: 0.9819 - val_loss: 0.1322 - val_accuracy: 0.9707 Epoch 16/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0611 - accuracy: 0.9835 - val_loss: 0.1346 - val_accuracy: 0.9715 Epoch 17/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0586 - accuracy: 0.9839 - val_loss: 0.1709 - val_accuracy: 0.9692 Epoch 18/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0588 - accuracy: 0.9846 - val_loss: 0.1441 - val_accuracy: 0.9727 Epoch 19/100 1688/1688 [==============================] - 5s 3ms/step - loss: 0.0497 - accuracy: 0.9864 - val_loss: 0.1391 - val_accuracy: 0.9732 Time to optimize: 1407.2442626953125
rnd_search_cv.best_params_
{'n_hidden': 3, 'activation': 'relu'}
rnd_search_cv.best_score_
0.96361110607783
task3_best_model = rnd_search_cv.best_estimator_.model
Follow the strategy on p.321 of the text; You will want to look at the following paremeters:
This will take about 30 minutes to do the training!
from sklearn.model_selection import RandomizedSearchCV
import time
t0 = time.time()
params_distribs = {"n_hidden":[2,3,4],"n_neurons":[200,300,400],"activation":["tanh","relu"]}
#
# Your code goes here
keras_class = keras.wrappers.scikit_learn.KerasClassifier(build_model)
rnd_search_cv = RandomizedSearchCV(keras_class, params_distribs, n_iter=10,cv=3)
rnd_search_cv.fit(train_images_temp,train_labels_cat_temp,epochs=100,
validation_data=(val_images,val_labels_cat),
callbacks=[keras.callbacks.EarlyStopping(patience=10)])
print("Time to optimize: ",time.time()-t0)
Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 2.3501 - accuracy: 0.8709 - val_loss: 0.6439 - val_accuracy: 0.9092 Epoch 2/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.4745 - accuracy: 0.9275 - val_loss: 0.4174 - val_accuracy: 0.9275 Epoch 3/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2688 - accuracy: 0.9453 - val_loss: 0.2637 - val_accuracy: 0.9427 Epoch 4/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2185 - accuracy: 0.9489 - val_loss: 0.2615 - val_accuracy: 0.9440 Epoch 5/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1644 - accuracy: 0.9556 - val_loss: 0.2705 - val_accuracy: 0.9407 Epoch 6/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1564 - accuracy: 0.9585 - val_loss: 0.1871 - val_accuracy: 0.9557 Epoch 7/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1557 - accuracy: 0.9598 - val_loss: 0.1741 - val_accuracy: 0.9533 Epoch 8/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1273 - accuracy: 0.9646 - val_loss: 0.1758 - val_accuracy: 0.9587 Epoch 9/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1038 - accuracy: 0.9707 - val_loss: 0.1748 - val_accuracy: 0.9582 Epoch 10/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1103 - accuracy: 0.9699 - val_loss: 0.1813 - val_accuracy: 0.9603 Epoch 11/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1049 - accuracy: 0.9724 - val_loss: 0.1586 - val_accuracy: 0.9610 Epoch 12/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1031 - accuracy: 0.9735 - val_loss: 0.2208 - val_accuracy: 0.9542 Epoch 13/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0956 - accuracy: 0.9763 - val_loss: 0.2020 - val_accuracy: 0.9662 Epoch 14/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0876 - accuracy: 0.9774 - val_loss: 0.1853 - val_accuracy: 0.9657 Epoch 15/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0773 - accuracy: 0.9801 - val_loss: 0.1863 - val_accuracy: 0.9655 Epoch 16/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0822 - accuracy: 0.9792 - val_loss: 0.1662 - val_accuracy: 0.9663 Epoch 17/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0713 - accuracy: 0.9819 - val_loss: 0.1895 - val_accuracy: 0.9675 Epoch 18/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0754 - accuracy: 0.9813 - val_loss: 0.2193 - val_accuracy: 0.9650 Epoch 19/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0778 - accuracy: 0.9816 - val_loss: 0.1990 - val_accuracy: 0.9628 Epoch 20/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0630 - accuracy: 0.9849 - val_loss: 0.1887 - val_accuracy: 0.9695 Epoch 21/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0674 - accuracy: 0.9840 - val_loss: 0.1996 - val_accuracy: 0.9703 563/563 [==============================] - 1s 2ms/step - loss: 0.2453 - accuracy: 0.9644 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 2.1636 - accuracy: 0.8718 - val_loss: 0.6473 - val_accuracy: 0.9178 Epoch 2/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.4126 - accuracy: 0.9313 - val_loss: 0.3888 - val_accuracy: 0.9368 Epoch 3/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2572 - accuracy: 0.9469 - val_loss: 0.2968 - val_accuracy: 0.9408 Epoch 4/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1795 - accuracy: 0.9567 - val_loss: 0.2678 - val_accuracy: 0.9488 Epoch 5/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1511 - accuracy: 0.9606 - val_loss: 0.2734 - val_accuracy: 0.9432 Epoch 6/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1386 - accuracy: 0.9615 - val_loss: 0.2214 - val_accuracy: 0.9513 Epoch 7/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1337 - accuracy: 0.9639 - val_loss: 0.2077 - val_accuracy: 0.9468 Epoch 8/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1244 - accuracy: 0.9669 - val_loss: 0.2027 - val_accuracy: 0.9553 Epoch 9/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1143 - accuracy: 0.9696 - val_loss: 0.1714 - val_accuracy: 0.9593 Epoch 10/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1005 - accuracy: 0.9723 - val_loss: 0.1719 - val_accuracy: 0.9577 Epoch 11/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0954 - accuracy: 0.9734 - val_loss: 0.1820 - val_accuracy: 0.9640 Epoch 12/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0911 - accuracy: 0.9754 - val_loss: 0.2084 - val_accuracy: 0.9573 Epoch 13/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0865 - accuracy: 0.9775 - val_loss: 0.2598 - val_accuracy: 0.9563 Epoch 14/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0853 - accuracy: 0.9778 - val_loss: 0.1682 - val_accuracy: 0.9663 Epoch 15/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0811 - accuracy: 0.9790 - val_loss: 0.2113 - val_accuracy: 0.9642 Epoch 16/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0804 - accuracy: 0.9799 - val_loss: 0.1658 - val_accuracy: 0.9678 Epoch 17/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0626 - accuracy: 0.9833 - val_loss: 0.2306 - val_accuracy: 0.9607 Epoch 18/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0677 - accuracy: 0.9838 - val_loss: 0.2133 - val_accuracy: 0.9637 Epoch 19/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0680 - accuracy: 0.9827 - val_loss: 0.2570 - val_accuracy: 0.9663 Epoch 20/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0657 - accuracy: 0.9847 - val_loss: 0.2521 - val_accuracy: 0.9605 Epoch 21/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0656 - accuracy: 0.9850 - val_loss: 0.2507 - val_accuracy: 0.9668 Epoch 22/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0594 - accuracy: 0.9866 - val_loss: 0.2776 - val_accuracy: 0.9555 Epoch 23/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0600 - accuracy: 0.9860 - val_loss: 0.2483 - val_accuracy: 0.9613 Epoch 24/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0569 - accuracy: 0.9867 - val_loss: 0.2978 - val_accuracy: 0.9650 Epoch 25/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0566 - accuracy: 0.9870 - val_loss: 0.2424 - val_accuracy: 0.9695 Epoch 26/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0482 - accuracy: 0.9895 - val_loss: 0.2793 - val_accuracy: 0.9678 563/563 [==============================] - 1s 2ms/step - loss: 0.3258 - accuracy: 0.9663 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 2.2694 - accuracy: 0.8683 - val_loss: 0.6491 - val_accuracy: 0.9222 Epoch 2/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.5207 - accuracy: 0.9278 - val_loss: 0.4477 - val_accuracy: 0.9357 Epoch 3/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2787 - accuracy: 0.9451 - val_loss: 0.3278 - val_accuracy: 0.9373 Epoch 4/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1890 - accuracy: 0.9548 - val_loss: 0.2686 - val_accuracy: 0.9365 Epoch 5/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1637 - accuracy: 0.9573 - val_loss: 0.1934 - val_accuracy: 0.9525 Epoch 6/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1416 - accuracy: 0.9617 - val_loss: 0.2017 - val_accuracy: 0.9492 Epoch 7/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1344 - accuracy: 0.9637 - val_loss: 0.2431 - val_accuracy: 0.9463 Epoch 8/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1410 - accuracy: 0.9637 - val_loss: 0.1880 - val_accuracy: 0.9515 Epoch 9/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1117 - accuracy: 0.9698 - val_loss: 0.1838 - val_accuracy: 0.9627 Epoch 10/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1193 - accuracy: 0.9698 - val_loss: 0.2296 - val_accuracy: 0.9530 Epoch 11/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1056 - accuracy: 0.9721 - val_loss: 0.1689 - val_accuracy: 0.9625 Epoch 12/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0963 - accuracy: 0.9755 - val_loss: 0.2500 - val_accuracy: 0.9502 Epoch 13/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0999 - accuracy: 0.9751 - val_loss: 0.2156 - val_accuracy: 0.9613 Epoch 14/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0798 - accuracy: 0.9793 - val_loss: 0.2182 - val_accuracy: 0.9592 Epoch 15/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0858 - accuracy: 0.9783 - val_loss: 0.2454 - val_accuracy: 0.9580 Epoch 16/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0821 - accuracy: 0.9797 - val_loss: 0.2409 - val_accuracy: 0.9525 Epoch 17/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0693 - accuracy: 0.9817 - val_loss: 0.2946 - val_accuracy: 0.9523 Epoch 18/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0689 - accuracy: 0.9833 - val_loss: 0.2051 - val_accuracy: 0.9643 Epoch 19/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0669 - accuracy: 0.9839 - val_loss: 0.2437 - val_accuracy: 0.9605 Epoch 20/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0773 - accuracy: 0.9828 - val_loss: 0.1967 - val_accuracy: 0.9627 Epoch 21/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.0597 - accuracy: 0.9859 - val_loss: 0.1953 - val_accuracy: 0.9675 563/563 [==============================] - 1s 2ms/step - loss: 0.2317 - accuracy: 0.9643 Epoch 1/100 1125/1125 [==============================] - 4s 4ms/step - loss: 0.5357 - accuracy: 0.8326 - val_loss: 0.4189 - val_accuracy: 0.8693 Epoch 2/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.4305 - accuracy: 0.8619 - val_loss: 0.4187 - val_accuracy: 0.8730 Epoch 3/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3842 - accuracy: 0.8775 - val_loss: 0.3464 - val_accuracy: 0.8940 Epoch 4/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3546 - accuracy: 0.8859 - val_loss: 0.3518 - val_accuracy: 0.8872 Epoch 5/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3401 - accuracy: 0.8923 - val_loss: 0.2885 - val_accuracy: 0.9088 Epoch 6/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3008 - accuracy: 0.9036 - val_loss: 0.3129 - val_accuracy: 0.9025 Epoch 7/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2806 - accuracy: 0.9114 - val_loss: 0.2502 - val_accuracy: 0.9203 Epoch 8/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2826 - accuracy: 0.9094 - val_loss: 0.2748 - val_accuracy: 0.9108 Epoch 9/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2611 - accuracy: 0.9179 - val_loss: 0.2678 - val_accuracy: 0.9167 Epoch 10/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2471 - accuracy: 0.9217 - val_loss: 0.2528 - val_accuracy: 0.9180 Epoch 11/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2383 - accuracy: 0.9237 - val_loss: 0.2258 - val_accuracy: 0.9270 Epoch 12/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2365 - accuracy: 0.9249 - val_loss: 0.2665 - val_accuracy: 0.9148 Epoch 13/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2422 - accuracy: 0.9221 - val_loss: 0.2259 - val_accuracy: 0.9295 Epoch 14/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2227 - accuracy: 0.9298 - val_loss: 0.2377 - val_accuracy: 0.9257 Epoch 15/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2190 - accuracy: 0.9297 - val_loss: 0.2317 - val_accuracy: 0.9262 Epoch 16/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2139 - accuracy: 0.9315 - val_loss: 0.2034 - val_accuracy: 0.9375 Epoch 17/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2091 - accuracy: 0.9329 - val_loss: 0.2374 - val_accuracy: 0.9220 Epoch 18/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2178 - accuracy: 0.9301 - val_loss: 0.2083 - val_accuracy: 0.9303 Epoch 19/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2075 - accuracy: 0.9322 - val_loss: 0.2244 - val_accuracy: 0.9310 Epoch 20/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2053 - accuracy: 0.9346 - val_loss: 0.2061 - val_accuracy: 0.9340 Epoch 21/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1978 - accuracy: 0.9374 - val_loss: 0.2099 - val_accuracy: 0.9320 Epoch 22/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1948 - accuracy: 0.9363 - val_loss: 0.2035 - val_accuracy: 0.9370 Epoch 23/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1928 - accuracy: 0.9362 - val_loss: 0.2097 - val_accuracy: 0.9348 Epoch 24/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1900 - accuracy: 0.9396 - val_loss: 0.2032 - val_accuracy: 0.9383 Epoch 25/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1814 - accuracy: 0.9431 - val_loss: 0.1909 - val_accuracy: 0.9428 Epoch 26/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1851 - accuracy: 0.9414 - val_loss: 0.2021 - val_accuracy: 0.9388 Epoch 27/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1811 - accuracy: 0.9427 - val_loss: 0.2019 - val_accuracy: 0.9375 Epoch 28/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1870 - accuracy: 0.9400 - val_loss: 0.1848 - val_accuracy: 0.9428 Epoch 29/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1767 - accuracy: 0.9439 - val_loss: 0.1970 - val_accuracy: 0.9420 Epoch 30/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1734 - accuracy: 0.9441 - val_loss: 0.1787 - val_accuracy: 0.9422 Epoch 31/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1678 - accuracy: 0.9462 - val_loss: 0.1807 - val_accuracy: 0.9425 Epoch 32/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1746 - accuracy: 0.9441 - val_loss: 0.1847 - val_accuracy: 0.9408 Epoch 33/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1681 - accuracy: 0.9470 - val_loss: 0.1765 - val_accuracy: 0.9448 Epoch 34/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1615 - accuracy: 0.9484 - val_loss: 0.1928 - val_accuracy: 0.9400 Epoch 35/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1642 - accuracy: 0.9478 - val_loss: 0.1932 - val_accuracy: 0.9438 Epoch 36/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1730 - accuracy: 0.9450 - val_loss: 0.1749 - val_accuracy: 0.9443 Epoch 37/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1628 - accuracy: 0.9471 - val_loss: 0.1770 - val_accuracy: 0.9440 Epoch 38/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1624 - accuracy: 0.9478 - val_loss: 0.1730 - val_accuracy: 0.9452 Epoch 39/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1574 - accuracy: 0.9494 - val_loss: 0.1765 - val_accuracy: 0.9448 Epoch 40/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1593 - accuracy: 0.9486 - val_loss: 0.1763 - val_accuracy: 0.9467 Epoch 41/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1565 - accuracy: 0.9503 - val_loss: 0.1727 - val_accuracy: 0.9480 Epoch 42/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1506 - accuracy: 0.9520 - val_loss: 0.1727 - val_accuracy: 0.9447 Epoch 43/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1561 - accuracy: 0.9487 - val_loss: 0.1698 - val_accuracy: 0.9487 Epoch 44/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1511 - accuracy: 0.9513 - val_loss: 0.1731 - val_accuracy: 0.9480 Epoch 45/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1541 - accuracy: 0.9508 - val_loss: 0.1712 - val_accuracy: 0.9462 Epoch 46/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1490 - accuracy: 0.9518 - val_loss: 0.1674 - val_accuracy: 0.9463 Epoch 47/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1412 - accuracy: 0.9543 - val_loss: 0.1595 - val_accuracy: 0.9495 Epoch 48/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1417 - accuracy: 0.9548 - val_loss: 0.1545 - val_accuracy: 0.9507 Epoch 49/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1295 - accuracy: 0.9584 - val_loss: 0.1579 - val_accuracy: 0.9515 Epoch 50/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1379 - accuracy: 0.9554 - val_loss: 0.1715 - val_accuracy: 0.9480 Epoch 51/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1378 - accuracy: 0.9545 - val_loss: 0.1761 - val_accuracy: 0.9488 Epoch 52/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1343 - accuracy: 0.9555 - val_loss: 0.1848 - val_accuracy: 0.9432 Epoch 53/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1376 - accuracy: 0.9553 - val_loss: 0.1645 - val_accuracy: 0.9497 Epoch 54/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1337 - accuracy: 0.9558 - val_loss: 0.1839 - val_accuracy: 0.9443 Epoch 55/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1403 - accuracy: 0.9539 - val_loss: 0.1788 - val_accuracy: 0.9472 Epoch 56/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1466 - accuracy: 0.9524 - val_loss: 0.1787 - val_accuracy: 0.9432 Epoch 57/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1387 - accuracy: 0.9555 - val_loss: 0.1622 - val_accuracy: 0.9490 Epoch 58/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1385 - accuracy: 0.9552 - val_loss: 0.1729 - val_accuracy: 0.9465 563/563 [==============================] - 1s 2ms/step - loss: 0.1725 - accuracy: 0.9466 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.5603 - accuracy: 0.8213 - val_loss: 0.5182 - val_accuracy: 0.8265 Epoch 2/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.4622 - accuracy: 0.8546 - val_loss: 0.3846 - val_accuracy: 0.8788 Epoch 3/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.4051 - accuracy: 0.8713 - val_loss: 0.3957 - val_accuracy: 0.8757 Epoch 4/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3488 - accuracy: 0.8889 - val_loss: 0.3212 - val_accuracy: 0.9002 Epoch 5/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3289 - accuracy: 0.8962 - val_loss: 0.3124 - val_accuracy: 0.9025 Epoch 6/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3116 - accuracy: 0.9008 - val_loss: 0.3038 - val_accuracy: 0.9043 Epoch 7/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2912 - accuracy: 0.9076 - val_loss: 0.2613 - val_accuracy: 0.9200 Epoch 8/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2621 - accuracy: 0.9159 - val_loss: 0.2660 - val_accuracy: 0.9153 Epoch 9/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2479 - accuracy: 0.9214 - val_loss: 0.2412 - val_accuracy: 0.9217 Epoch 10/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2474 - accuracy: 0.9207 - val_loss: 0.2861 - val_accuracy: 0.9063 Epoch 11/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2455 - accuracy: 0.9211 - val_loss: 0.2525 - val_accuracy: 0.9222 Epoch 12/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2434 - accuracy: 0.9209 - val_loss: 0.2344 - val_accuracy: 0.9217 Epoch 13/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2297 - accuracy: 0.9258 - val_loss: 0.2325 - val_accuracy: 0.9233 Epoch 14/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2244 - accuracy: 0.9275 - val_loss: 0.2272 - val_accuracy: 0.9258 Epoch 15/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2173 - accuracy: 0.9313 - val_loss: 0.2334 - val_accuracy: 0.9263 Epoch 16/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2161 - accuracy: 0.9292 - val_loss: 0.2205 - val_accuracy: 0.9303 Epoch 17/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1993 - accuracy: 0.9358 - val_loss: 0.2211 - val_accuracy: 0.9297 Epoch 18/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2027 - accuracy: 0.9344 - val_loss: 0.2045 - val_accuracy: 0.9412 Epoch 19/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1969 - accuracy: 0.9357 - val_loss: 0.1933 - val_accuracy: 0.9405 Epoch 20/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1884 - accuracy: 0.9407 - val_loss: 0.2004 - val_accuracy: 0.9400 Epoch 21/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1880 - accuracy: 0.9392 - val_loss: 0.1914 - val_accuracy: 0.9427 Epoch 22/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1827 - accuracy: 0.9407 - val_loss: 0.2068 - val_accuracy: 0.9332 Epoch 23/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1732 - accuracy: 0.9440 - val_loss: 0.1965 - val_accuracy: 0.9380 Epoch 24/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1785 - accuracy: 0.9424 - val_loss: 0.1983 - val_accuracy: 0.9400 Epoch 25/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1673 - accuracy: 0.9460 - val_loss: 0.1737 - val_accuracy: 0.9453 Epoch 26/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1712 - accuracy: 0.9445 - val_loss: 0.1705 - val_accuracy: 0.9453 Epoch 27/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1743 - accuracy: 0.9436 - val_loss: 0.1752 - val_accuracy: 0.9428 Epoch 28/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1670 - accuracy: 0.9469 - val_loss: 0.1778 - val_accuracy: 0.9430 Epoch 29/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1721 - accuracy: 0.9438 - val_loss: 0.1797 - val_accuracy: 0.9442 Epoch 30/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1711 - accuracy: 0.9434 - val_loss: 0.1821 - val_accuracy: 0.9440 Epoch 31/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1667 - accuracy: 0.9471 - val_loss: 0.2021 - val_accuracy: 0.9335 Epoch 32/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1728 - accuracy: 0.9445 - val_loss: 0.1933 - val_accuracy: 0.9403 Epoch 33/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1681 - accuracy: 0.9452 - val_loss: 0.1772 - val_accuracy: 0.9460 Epoch 34/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1637 - accuracy: 0.9469 - val_loss: 0.1707 - val_accuracy: 0.9457 Epoch 35/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1543 - accuracy: 0.9511 - val_loss: 0.1615 - val_accuracy: 0.9497 Epoch 36/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1559 - accuracy: 0.9494 - val_loss: 0.1720 - val_accuracy: 0.9457 Epoch 37/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1502 - accuracy: 0.9511 - val_loss: 0.1613 - val_accuracy: 0.9475 Epoch 38/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1546 - accuracy: 0.9492 - val_loss: 0.1873 - val_accuracy: 0.9432 Epoch 39/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1632 - accuracy: 0.9471 - val_loss: 0.1762 - val_accuracy: 0.9447 Epoch 40/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1625 - accuracy: 0.9482 - val_loss: 0.1826 - val_accuracy: 0.9427 Epoch 41/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1537 - accuracy: 0.9498 - val_loss: 0.1779 - val_accuracy: 0.9462 Epoch 42/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1509 - accuracy: 0.9504 - val_loss: 0.1741 - val_accuracy: 0.9465 Epoch 43/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1489 - accuracy: 0.9517 - val_loss: 0.1689 - val_accuracy: 0.9448 Epoch 44/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1509 - accuracy: 0.9516 - val_loss: 0.1733 - val_accuracy: 0.9482 Epoch 45/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1508 - accuracy: 0.9510 - val_loss: 0.1596 - val_accuracy: 0.9475 Epoch 46/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1404 - accuracy: 0.9539 - val_loss: 0.1534 - val_accuracy: 0.9528 Epoch 47/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1406 - accuracy: 0.9551 - val_loss: 0.1668 - val_accuracy: 0.9493 Epoch 48/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1398 - accuracy: 0.9542 - val_loss: 0.1554 - val_accuracy: 0.9480 Epoch 49/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1381 - accuracy: 0.9536 - val_loss: 0.1549 - val_accuracy: 0.9518 Epoch 50/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1398 - accuracy: 0.9545 - val_loss: 0.1556 - val_accuracy: 0.9532 Epoch 51/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1402 - accuracy: 0.9533 - val_loss: 0.1522 - val_accuracy: 0.9532 Epoch 52/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1420 - accuracy: 0.9528 - val_loss: 0.1586 - val_accuracy: 0.9490 Epoch 53/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1409 - accuracy: 0.9539 - val_loss: 0.1636 - val_accuracy: 0.9533 Epoch 54/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1455 - accuracy: 0.9521 - val_loss: 0.1670 - val_accuracy: 0.9485 Epoch 55/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1394 - accuracy: 0.9552 - val_loss: 0.1700 - val_accuracy: 0.9493 Epoch 56/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1375 - accuracy: 0.9556 - val_loss: 0.1630 - val_accuracy: 0.9523 Epoch 57/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1309 - accuracy: 0.9574 - val_loss: 0.1581 - val_accuracy: 0.9535 Epoch 58/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1334 - accuracy: 0.9570 - val_loss: 0.1631 - val_accuracy: 0.9495 Epoch 59/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1308 - accuracy: 0.9578 - val_loss: 0.1566 - val_accuracy: 0.9515 Epoch 60/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1297 - accuracy: 0.9578 - val_loss: 0.1602 - val_accuracy: 0.9537 Epoch 61/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1355 - accuracy: 0.9563 - val_loss: 0.1570 - val_accuracy: 0.9517 563/563 [==============================] - 1s 2ms/step - loss: 0.1648 - accuracy: 0.9481 Epoch 1/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.5295 - accuracy: 0.8317 - val_loss: 0.4306 - val_accuracy: 0.8657 Epoch 2/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3974 - accuracy: 0.8735 - val_loss: 0.3506 - val_accuracy: 0.8885 Epoch 3/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3564 - accuracy: 0.8871 - val_loss: 0.3359 - val_accuracy: 0.8910 Epoch 4/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.3208 - accuracy: 0.8981 - val_loss: 0.3373 - val_accuracy: 0.8928 Epoch 5/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2983 - accuracy: 0.9073 - val_loss: 0.3119 - val_accuracy: 0.9020 Epoch 6/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2929 - accuracy: 0.9073 - val_loss: 0.2694 - val_accuracy: 0.9148 Epoch 7/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2749 - accuracy: 0.9129 - val_loss: 0.2963 - val_accuracy: 0.8998 Epoch 8/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2760 - accuracy: 0.9123 - val_loss: 0.2849 - val_accuracy: 0.9102 Epoch 9/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2617 - accuracy: 0.9155 - val_loss: 0.2673 - val_accuracy: 0.9137 Epoch 10/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2501 - accuracy: 0.9197 - val_loss: 0.2467 - val_accuracy: 0.9245 Epoch 11/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2408 - accuracy: 0.9233 - val_loss: 0.2402 - val_accuracy: 0.9235 Epoch 12/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2284 - accuracy: 0.9265 - val_loss: 0.2315 - val_accuracy: 0.9235 Epoch 13/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2201 - accuracy: 0.9283 - val_loss: 0.1989 - val_accuracy: 0.9348 Epoch 14/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2240 - accuracy: 0.9281 - val_loss: 0.2071 - val_accuracy: 0.9342 Epoch 15/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2150 - accuracy: 0.9321 - val_loss: 0.2074 - val_accuracy: 0.9353 Epoch 16/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2105 - accuracy: 0.9326 - val_loss: 0.2194 - val_accuracy: 0.9278 Epoch 17/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2054 - accuracy: 0.9351 - val_loss: 0.2007 - val_accuracy: 0.9368 Epoch 18/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.2007 - accuracy: 0.9354 - val_loss: 0.1883 - val_accuracy: 0.9405 Epoch 19/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1883 - accuracy: 0.9386 - val_loss: 0.1843 - val_accuracy: 0.9403 Epoch 20/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1830 - accuracy: 0.9420 - val_loss: 0.1982 - val_accuracy: 0.9370 Epoch 21/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1878 - accuracy: 0.9408 - val_loss: 0.1860 - val_accuracy: 0.9400 Epoch 22/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1847 - accuracy: 0.9399 - val_loss: 0.1827 - val_accuracy: 0.9418 Epoch 23/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1916 - accuracy: 0.9373 - val_loss: 0.1912 - val_accuracy: 0.9385 Epoch 24/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1915 - accuracy: 0.9382 - val_loss: 0.1966 - val_accuracy: 0.9375 Epoch 25/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1890 - accuracy: 0.9391 - val_loss: 0.1939 - val_accuracy: 0.9390 Epoch 26/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1794 - accuracy: 0.9427 - val_loss: 0.1826 - val_accuracy: 0.9442 Epoch 27/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1765 - accuracy: 0.9430 - val_loss: 0.1855 - val_accuracy: 0.9395 Epoch 28/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1765 - accuracy: 0.9437 - val_loss: 0.1921 - val_accuracy: 0.9342 Epoch 29/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1658 - accuracy: 0.9448 - val_loss: 0.1804 - val_accuracy: 0.9423 Epoch 30/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1728 - accuracy: 0.9434 - val_loss: 0.1738 - val_accuracy: 0.9427 Epoch 31/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1724 - accuracy: 0.9440 - val_loss: 0.1975 - val_accuracy: 0.9398 Epoch 32/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1709 - accuracy: 0.9446 - val_loss: 0.1853 - val_accuracy: 0.9405 Epoch 33/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1620 - accuracy: 0.9476 - val_loss: 0.1768 - val_accuracy: 0.9432 Epoch 34/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1574 - accuracy: 0.9497 - val_loss: 0.1700 - val_accuracy: 0.9450 Epoch 35/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1532 - accuracy: 0.9501 - val_loss: 0.1721 - val_accuracy: 0.9465 Epoch 36/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1506 - accuracy: 0.9509 - val_loss: 0.1666 - val_accuracy: 0.9482 Epoch 37/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1455 - accuracy: 0.9537 - val_loss: 0.1738 - val_accuracy: 0.9448 Epoch 38/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1472 - accuracy: 0.9535 - val_loss: 0.1636 - val_accuracy: 0.9527 Epoch 39/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1486 - accuracy: 0.9515 - val_loss: 0.1732 - val_accuracy: 0.9475 Epoch 40/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1446 - accuracy: 0.9536 - val_loss: 0.1700 - val_accuracy: 0.9470 Epoch 41/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1398 - accuracy: 0.9549 - val_loss: 0.1524 - val_accuracy: 0.9505 Epoch 42/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1436 - accuracy: 0.9536 - val_loss: 0.1799 - val_accuracy: 0.9457 Epoch 43/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1462 - accuracy: 0.9526 - val_loss: 0.1724 - val_accuracy: 0.9473 Epoch 44/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1495 - accuracy: 0.9507 - val_loss: 0.1665 - val_accuracy: 0.9473 Epoch 45/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1510 - accuracy: 0.9511 - val_loss: 0.1818 - val_accuracy: 0.9453 Epoch 46/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1491 - accuracy: 0.9517 - val_loss: 0.1639 - val_accuracy: 0.9487 loss: 0.1504 - accuracy Epoch 47/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1450 - accuracy: 0.9511 - val_loss: 0.1529 - val_accuracy: 0.9523 Epoch 48/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1388 - accuracy: 0.9542 - val_loss: 0.1646 - val_accuracy: 0.9488 Epoch 49/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1297 - accuracy: 0.9586 - val_loss: 0.1724 - val_accuracy: 0.9463 Epoch 50/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1413 - accuracy: 0.9531 - val_loss: 0.1787 - val_accuracy: 0.9477 Epoch 51/100 1125/1125 [==============================] - 4s 3ms/step - loss: 0.1412 - accuracy: 0.9545 - val_loss: 0.1767 - val_accuracy: 0.9435 563/563 [==============================] - 1s 1ms/step - loss: 0.1802 - accuracy: 0.9454 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 1.4203 - accuracy: 0.8784 - val_loss: 0.3915 - val_accuracy: 0.9120 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2371 - accuracy: 0.9383 - val_loss: 0.2131 - val_accuracy: 0.9495 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1776 - accuracy: 0.9507 - val_loss: 0.1880 - val_accuracy: 0.9525 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1512 - accuracy: 0.9566 - val_loss: 0.2382 - val_accuracy: 0.9390 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1461 - accuracy: 0.9593 - val_loss: 0.1937 - val_accuracy: 0.9610 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1342 - accuracy: 0.9638 - val_loss: 0.1641 - val_accuracy: 0.9565 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1231 - accuracy: 0.9664 - val_loss: 0.1895 - val_accuracy: 0.9527 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1122 - accuracy: 0.9700 - val_loss: 0.2188 - val_accuracy: 0.9530 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1011 - accuracy: 0.9731 - val_loss: 0.1392 - val_accuracy: 0.9707 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0929 - accuracy: 0.9763 - val_loss: 0.1529 - val_accuracy: 0.9695 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0883 - accuracy: 0.9774 - val_loss: 0.2076 - val_accuracy: 0.9582 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0822 - accuracy: 0.9794 - val_loss: 0.1660 - val_accuracy: 0.9675 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0801 - accuracy: 0.9807 - val_loss: 0.2205 - val_accuracy: 0.9657 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0783 - accuracy: 0.9812 - val_loss: 0.2500 - val_accuracy: 0.9500 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0704 - accuracy: 0.9824 - val_loss: 0.2017 - val_accuracy: 0.9675 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0669 - accuracy: 0.9836 - val_loss: 0.1751 - val_accuracy: 0.9678 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0595 - accuracy: 0.9855 - val_loss: 0.2075 - val_accuracy: 0.9715 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0664 - accuracy: 0.9854 - val_loss: 0.1582 - val_accuracy: 0.9745 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0628 - accuracy: 0.9858 - val_loss: 0.1935 - val_accuracy: 0.9732 563/563 [==============================] - 1s 2ms/step - loss: 0.1820 - accuracy: 0.9702 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 1.3562 - accuracy: 0.8787 - val_loss: 0.3113 - val_accuracy: 0.9277 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2375 - accuracy: 0.9389 - val_loss: 0.2112 - val_accuracy: 0.9375 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1580 - accuracy: 0.9537 - val_loss: 0.2371 - val_accuracy: 0.9345 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1568 - accuracy: 0.9562 - val_loss: 0.2105 - val_accuracy: 0.9505 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1320 - accuracy: 0.9630 - val_loss: 0.1604 - val_accuracy: 0.9602 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1274 - accuracy: 0.9651 - val_loss: 0.1511 - val_accuracy: 0.9632 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1143 - accuracy: 0.9685 - val_loss: 0.1967 - val_accuracy: 0.9570 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1179 - accuracy: 0.9703 - val_loss: 0.1734 - val_accuracy: 0.9520 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0921 - accuracy: 0.9752 - val_loss: 0.1478 - val_accuracy: 0.9653 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0915 - accuracy: 0.9766 - val_loss: 0.2005 - val_accuracy: 0.9575 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0877 - accuracy: 0.9771 - val_loss: 0.1454 - val_accuracy: 0.9662 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0696 - accuracy: 0.9823 - val_loss: 0.1781 - val_accuracy: 0.9703 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0802 - accuracy: 0.9808 - val_loss: 0.2234 - val_accuracy: 0.9590 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0685 - accuracy: 0.9822 - val_loss: 0.1550 - val_accuracy: 0.9707 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0671 - accuracy: 0.9832 - val_loss: 0.1553 - val_accuracy: 0.9708 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0543 - accuracy: 0.9856 - val_loss: 0.1668 - val_accuracy: 0.9688 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0552 - accuracy: 0.9862 - val_loss: 0.2061 - val_accuracy: 0.9703 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0684 - accuracy: 0.9852 - val_loss: 0.2031 - val_accuracy: 0.9665 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0631 - accuracy: 0.9868 - val_loss: 0.1694 - val_accuracy: 0.9740 Epoch 20/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0379 - accuracy: 0.9906 - val_loss: 0.1671 - val_accuracy: 0.9747 Epoch 21/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0507 - accuracy: 0.9883 - val_loss: 0.2153 - val_accuracy: 0.9713 563/563 [==============================] - 1s 2ms/step - loss: 0.2334 - accuracy: 0.9686 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 1.2582 - accuracy: 0.8830 - val_loss: 0.3007 - val_accuracy: 0.9258 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1987 - accuracy: 0.9457 - val_loss: 0.2134 - val_accuracy: 0.9438 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1642 - accuracy: 0.9554 - val_loss: 0.2050 - val_accuracy: 0.9427 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1444 - accuracy: 0.9602 - val_loss: 0.1918 - val_accuracy: 0.9502 Epoch 5/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1315 - accuracy: 0.9635 - val_loss: 0.1606 - val_accuracy: 0.9588 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1242 - accuracy: 0.9654 - val_loss: 0.1623 - val_accuracy: 0.9582 Epoch 7/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1086 - accuracy: 0.9701 - val_loss: 0.1706 - val_accuracy: 0.9580 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1196 - accuracy: 0.9694 - val_loss: 0.2643 - val_accuracy: 0.9438 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0917 - accuracy: 0.9746 - val_loss: 0.1961 - val_accuracy: 0.9588 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0921 - accuracy: 0.9759 - val_loss: 0.1462 - val_accuracy: 0.9687 Epoch 11/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.0782 - accuracy: 0.9800 - val_loss: 0.1346 - val_accuracy: 0.9693 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0744 - accuracy: 0.9816 - val_loss: 0.1726 - val_accuracy: 0.9600 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0726 - accuracy: 0.9823 - val_loss: 0.1372 - val_accuracy: 0.9695 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0614 - accuracy: 0.9846 - val_loss: 0.1439 - val_accuracy: 0.9712 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0602 - accuracy: 0.9854 - val_loss: 0.1744 - val_accuracy: 0.9658 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0604 - accuracy: 0.9863 - val_loss: 0.2003 - val_accuracy: 0.9662 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0627 - accuracy: 0.9855 - val_loss: 0.1820 - val_accuracy: 0.9708 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0653 - accuracy: 0.9859 - val_loss: 0.1990 - val_accuracy: 0.9683 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0481 - accuracy: 0.9891 - val_loss: 0.1905 - val_accuracy: 0.9657 Epoch 20/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0605 - accuracy: 0.9859 - val_loss: 0.1674 - val_accuracy: 0.9735 Epoch 21/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0458 - accuracy: 0.9896 - val_loss: 0.2785 - val_accuracy: 0.9713 563/563 [==============================] - 1s 2ms/step - loss: 0.3046 - accuracy: 0.9679 Epoch 1/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.5123 - accuracy: 0.8353 - val_loss: 0.3739 - val_accuracy: 0.8835 Epoch 2/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3796 - accuracy: 0.8764 - val_loss: 0.3195 - val_accuracy: 0.8983 Epoch 3/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3510 - accuracy: 0.8863 - val_loss: 0.2883 - val_accuracy: 0.9080 Epoch 4/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3053 - accuracy: 0.9015 - val_loss: 0.3137 - val_accuracy: 0.9017 Epoch 5/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2651 - accuracy: 0.9146 - val_loss: 0.3361 - val_accuracy: 0.8948 Epoch 6/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2837 - accuracy: 0.9099 - val_loss: 0.2733 - val_accuracy: 0.9110 Epoch 7/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2723 - accuracy: 0.9132 - val_loss: 0.2727 - val_accuracy: 0.9118 Epoch 8/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2730 - accuracy: 0.9118 - val_loss: 0.2731 - val_accuracy: 0.9142 Epoch 9/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2631 - accuracy: 0.9161 - val_loss: 0.2675 - val_accuracy: 0.9157 Epoch 10/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2568 - accuracy: 0.9176 - val_loss: 0.2449 - val_accuracy: 0.9243 Epoch 11/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2311 - accuracy: 0.9256 - val_loss: 0.2160 - val_accuracy: 0.9323 Epoch 12/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2273 - accuracy: 0.9246 - val_loss: 0.2208 - val_accuracy: 0.9305 Epoch 13/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2343 - accuracy: 0.9246 - val_loss: 0.2256 - val_accuracy: 0.9323 Epoch 14/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2199 - accuracy: 0.9299 - val_loss: 0.2051 - val_accuracy: 0.9382 Epoch 15/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2172 - accuracy: 0.9311 - val_loss: 0.2172 - val_accuracy: 0.9328 Epoch 16/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2206 - accuracy: 0.9277 - val_loss: 0.2269 - val_accuracy: 0.9325 Epoch 17/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2101 - accuracy: 0.9317 - val_loss: 0.2147 - val_accuracy: 0.9322 Epoch 18/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2122 - accuracy: 0.9322 - val_loss: 0.2211 - val_accuracy: 0.9283 Epoch 19/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2121 - accuracy: 0.9298 - val_loss: 0.2181 - val_accuracy: 0.9337 Epoch 20/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2085 - accuracy: 0.9335 - val_loss: 0.2026 - val_accuracy: 0.9372 Epoch 21/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1999 - accuracy: 0.9371 - val_loss: 0.1967 - val_accuracy: 0.9392 Epoch 22/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2055 - accuracy: 0.9348 - val_loss: 0.2371 - val_accuracy: 0.9272 Epoch 23/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2017 - accuracy: 0.9353 - val_loss: 0.2152 - val_accuracy: 0.9333 Epoch 24/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2052 - accuracy: 0.9341 - val_loss: 0.2017 - val_accuracy: 0.9372 Epoch 25/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2026 - accuracy: 0.9354 - val_loss: 0.2303 - val_accuracy: 0.9272 Epoch 26/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1993 - accuracy: 0.9351 - val_loss: 0.2102 - val_accuracy: 0.9333 Epoch 27/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1904 - accuracy: 0.9389 - val_loss: 0.2215 - val_accuracy: 0.9310 Epoch 28/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1991 - accuracy: 0.9371 - val_loss: 0.2200 - val_accuracy: 0.9317 Epoch 29/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1878 - accuracy: 0.9401 - val_loss: 0.1916 - val_accuracy: 0.9407 Epoch 30/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1847 - accuracy: 0.9412 - val_loss: 0.2065 - val_accuracy: 0.9380 Epoch 31/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1883 - accuracy: 0.9397 - val_loss: 0.2022 - val_accuracy: 0.9373 Epoch 32/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1795 - accuracy: 0.9427 - val_loss: 0.1992 - val_accuracy: 0.9407 Epoch 33/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1697 - accuracy: 0.9460 - val_loss: 0.2087 - val_accuracy: 0.9395 Epoch 34/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1741 - accuracy: 0.9431 - val_loss: 0.2037 - val_accuracy: 0.9352 Epoch 35/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1704 - accuracy: 0.9450 - val_loss: 0.1887 - val_accuracy: 0.9447 Epoch 36/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1817 - accuracy: 0.9413 - val_loss: 0.1922 - val_accuracy: 0.9402 Epoch 37/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1757 - accuracy: 0.9441 - val_loss: 0.1983 - val_accuracy: 0.9393 Epoch 38/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1778 - accuracy: 0.9422 - val_loss: 0.1983 - val_accuracy: 0.9387 Epoch 39/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1754 - accuracy: 0.9442 - val_loss: 0.1901 - val_accuracy: 0.9423 Epoch 40/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.1782 - accuracy: 0.9424 - val_loss: 0.2023 - val_accuracy: 0.9362 Epoch 41/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1850 - accuracy: 0.9406 - val_loss: 0.1890 - val_accuracy: 0.9420 Epoch 42/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1745 - accuracy: 0.9437 - val_loss: 0.1920 - val_accuracy: 0.9402 Epoch 43/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1712 - accuracy: 0.9445 - val_loss: 0.1923 - val_accuracy: 0.9403 Epoch 44/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1724 - accuracy: 0.9450 - val_loss: 0.2117 - val_accuracy: 0.9347 Epoch 45/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1754 - accuracy: 0.9444 - val_loss: 0.1769 - val_accuracy: 0.9462 Epoch 46/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1604 - accuracy: 0.9482 - val_loss: 0.1646 - val_accuracy: 0.9500 Epoch 47/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.1634 - accuracy: 0.9478 - val_loss: 0.1859 - val_accuracy: 0.9428 Epoch 48/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1727 - accuracy: 0.9453 - val_loss: 0.1930 - val_accuracy: 0.9447 Epoch 49/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1691 - accuracy: 0.9470 - val_loss: 0.2008 - val_accuracy: 0.9413 Epoch 50/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1709 - accuracy: 0.9458 - val_loss: 0.2064 - val_accuracy: 0.9350 Epoch 51/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1754 - accuracy: 0.9451 - val_loss: 0.2045 - val_accuracy: 0.9397 Epoch 52/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1755 - accuracy: 0.9439 - val_loss: 0.1830 - val_accuracy: 0.9438 Epoch 53/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1706 - accuracy: 0.9453 - val_loss: 0.2048 - val_accuracy: 0.9412 Epoch 54/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1684 - accuracy: 0.9455 - val_loss: 0.2057 - val_accuracy: 0.9392 Epoch 55/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1723 - accuracy: 0.9452 - val_loss: 0.2027 - val_accuracy: 0.9372 Epoch 56/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1667 - accuracy: 0.9475 - val_loss: 0.1925 - val_accuracy: 0.9453 563/563 [==============================] - 1s 2ms/step - loss: 0.1912 - accuracy: 0.9421 Epoch 1/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.5179 - accuracy: 0.8336 - val_loss: 0.4476 - val_accuracy: 0.8543 Epoch 2/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3867 - accuracy: 0.8756 - val_loss: 0.3725 - val_accuracy: 0.8773 Epoch 3/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3370 - accuracy: 0.8927 - val_loss: 0.3392 - val_accuracy: 0.8860 Epoch 4/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3092 - accuracy: 0.8989 - val_loss: 0.3068 - val_accuracy: 0.9037 Epoch 5/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3076 - accuracy: 0.9003 - val_loss: 0.2902 - val_accuracy: 0.9060 Epoch 6/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2878 - accuracy: 0.9068 - val_loss: 0.2625 - val_accuracy: 0.9172 Epoch 7/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2718 - accuracy: 0.9125 - val_loss: 0.2460 - val_accuracy: 0.9218 Epoch 8/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2680 - accuracy: 0.9126 - val_loss: 0.3004 - val_accuracy: 0.9068 Epoch 9/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2665 - accuracy: 0.9141 - val_loss: 0.2698 - val_accuracy: 0.9123 Epoch 10/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2646 - accuracy: 0.9147 - val_loss: 0.2392 - val_accuracy: 0.9257 Epoch 11/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2438 - accuracy: 0.9208 - val_loss: 0.2420 - val_accuracy: 0.9238 Epoch 12/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2315 - accuracy: 0.9266 - val_loss: 0.2529 - val_accuracy: 0.9223 Epoch 13/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2374 - accuracy: 0.9240 - val_loss: 0.2242 - val_accuracy: 0.9270 Epoch 14/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2341 - accuracy: 0.9237 - val_loss: 0.2241 - val_accuracy: 0.9283 Epoch 15/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2306 - accuracy: 0.9264 - val_loss: 0.2404 - val_accuracy: 0.9220 Epoch 16/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2255 - accuracy: 0.9268 - val_loss: 0.2255 - val_accuracy: 0.9263 Epoch 17/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2144 - accuracy: 0.9307 - val_loss: 0.2306 - val_accuracy: 0.9267 Epoch 18/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2083 - accuracy: 0.9334 - val_loss: 0.1970 - val_accuracy: 0.9383 Epoch 19/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1999 - accuracy: 0.9354 - val_loss: 0.2134 - val_accuracy: 0.9348 Epoch 20/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2104 - accuracy: 0.9326 - val_loss: 0.2031 - val_accuracy: 0.9378 Epoch 21/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2094 - accuracy: 0.9337 - val_loss: 0.1936 - val_accuracy: 0.9397 Epoch 22/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1953 - accuracy: 0.9377 - val_loss: 0.2137 - val_accuracy: 0.9343 Epoch 23/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1971 - accuracy: 0.9367 - val_loss: 0.2068 - val_accuracy: 0.9345 Epoch 24/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1918 - accuracy: 0.9388 - val_loss: 0.2002 - val_accuracy: 0.9390 Epoch 25/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1874 - accuracy: 0.9402 - val_loss: 0.1904 - val_accuracy: 0.9395 Epoch 26/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1885 - accuracy: 0.9388 - val_loss: 0.1925 - val_accuracy: 0.9387 Epoch 27/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1916 - accuracy: 0.9383 - val_loss: 0.2076 - val_accuracy: 0.9372 Epoch 28/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1949 - accuracy: 0.9380 - val_loss: 0.1970 - val_accuracy: 0.9380 Epoch 29/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1912 - accuracy: 0.9383 - val_loss: 0.1832 - val_accuracy: 0.9437 Epoch 30/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.1810 - accuracy: 0.9419 - val_loss: 0.1887 - val_accuracy: 0.9410 Epoch 31/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1825 - accuracy: 0.9418 - val_loss: 0.2098 - val_accuracy: 0.9367 Epoch 32/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1861 - accuracy: 0.9401 - val_loss: 0.1917 - val_accuracy: 0.9410 Epoch 33/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1752 - accuracy: 0.9439 - val_loss: 0.2019 - val_accuracy: 0.9382 Epoch 34/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1761 - accuracy: 0.9436 - val_loss: 0.1861 - val_accuracy: 0.9418 Epoch 35/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1714 - accuracy: 0.9444 - val_loss: 0.2267 - val_accuracy: 0.9230 Epoch 36/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1723 - accuracy: 0.9437 - val_loss: 0.1795 - val_accuracy: 0.9453 Epoch 37/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1718 - accuracy: 0.9448 - val_loss: 0.1762 - val_accuracy: 0.9477 Epoch 38/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1733 - accuracy: 0.9444 - val_loss: 0.1971 - val_accuracy: 0.9372 Epoch 39/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1817 - accuracy: 0.9422 - val_loss: 0.2127 - val_accuracy: 0.9345 Epoch 40/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1812 - accuracy: 0.9410 - val_loss: 0.1873 - val_accuracy: 0.9413 Epoch 41/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.1792 - accuracy: 0.9434 - val_loss: 0.1926 - val_accuracy: 0.9410 Epoch 42/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1775 - accuracy: 0.9440 - val_loss: 0.1947 - val_accuracy: 0.9397 Epoch 43/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1805 - accuracy: 0.9413 - val_loss: 0.1865 - val_accuracy: 0.9432 Epoch 44/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1779 - accuracy: 0.9431 - val_loss: 0.1923 - val_accuracy: 0.9392 Epoch 45/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1694 - accuracy: 0.9460 - val_loss: 0.1964 - val_accuracy: 0.9393 Epoch 46/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1707 - accuracy: 0.9448 - val_loss: 0.1695 - val_accuracy: 0.9480 Epoch 47/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1597 - accuracy: 0.9495 - val_loss: 0.1681 - val_accuracy: 0.9497 Epoch 48/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1594 - accuracy: 0.9499 - val_loss: 0.1951 - val_accuracy: 0.9437 Epoch 49/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1622 - accuracy: 0.9489 - val_loss: 0.1812 - val_accuracy: 0.9438 Epoch 50/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1568 - accuracy: 0.9494 - val_loss: 0.1822 - val_accuracy: 0.9452 Epoch 51/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1519 - accuracy: 0.9508 - val_loss: 0.1841 - val_accuracy: 0.9452 Epoch 52/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1604 - accuracy: 0.9482 - val_loss: 0.1752 - val_accuracy: 0.9457 Epoch 53/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1706 - accuracy: 0.9449 - val_loss: 0.1761 - val_accuracy: 0.9438 Epoch 54/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1732 - accuracy: 0.9446 - val_loss: 0.1867 - val_accuracy: 0.9415 Epoch 55/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1716 - accuracy: 0.9439 - val_loss: 0.1847 - val_accuracy: 0.9422 Epoch 56/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1734 - accuracy: 0.9438 - val_loss: 0.1834 - val_accuracy: 0.9432 Epoch 57/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1709 - accuracy: 0.9452 - val_loss: 0.1891 - val_accuracy: 0.9402 563/563 [==============================] - 1s 2ms/step - loss: 0.2072 - accuracy: 0.9347 Epoch 1/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.5156 - accuracy: 0.8319 - val_loss: 0.4019 - val_accuracy: 0.8668 Epoch 2/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3548 - accuracy: 0.8863 - val_loss: 0.3200 - val_accuracy: 0.8938 Epoch 3/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3356 - accuracy: 0.8909 - val_loss: 0.3004 - val_accuracy: 0.9022 Epoch 4/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.3183 - accuracy: 0.8967 - val_loss: 0.3545 - val_accuracy: 0.8868 Epoch 5/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2917 - accuracy: 0.9054 - val_loss: 0.2870 - val_accuracy: 0.9102 Epoch 6/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2738 - accuracy: 0.9110 - val_loss: 0.2998 - val_accuracy: 0.9032 Epoch 7/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2805 - accuracy: 0.9088 - val_loss: 0.2453 - val_accuracy: 0.9235 Epoch 8/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2529 - accuracy: 0.9183 - val_loss: 0.2752 - val_accuracy: 0.9112 Epoch 9/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2542 - accuracy: 0.9189 - val_loss: 0.2651 - val_accuracy: 0.9182 Epoch 10/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2375 - accuracy: 0.9250 - val_loss: 0.2364 - val_accuracy: 0.9262 Epoch 11/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2334 - accuracy: 0.9258 - val_loss: 0.2671 - val_accuracy: 0.9122 Epoch 12/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2370 - accuracy: 0.9240 - val_loss: 0.2377 - val_accuracy: 0.9252 Epoch 13/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2400 - accuracy: 0.9239 - val_loss: 0.2280 - val_accuracy: 0.9267 Epoch 14/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2342 - accuracy: 0.9258 - val_loss: 0.2393 - val_accuracy: 0.9275 Epoch 15/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2254 - accuracy: 0.9288 - val_loss: 0.2107 - val_accuracy: 0.9320 Epoch 16/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.2160 - accuracy: 0.9296 - val_loss: 0.2343 - val_accuracy: 0.9263 Epoch 17/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2093 - accuracy: 0.9333 - val_loss: 0.2254 - val_accuracy: 0.9283 Epoch 18/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2136 - accuracy: 0.9312 - val_loss: 0.2079 - val_accuracy: 0.9350 Epoch 19/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2019 - accuracy: 0.9353 - val_loss: 0.2042 - val_accuracy: 0.9353 Epoch 20/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2064 - accuracy: 0.9332 - val_loss: 0.2384 - val_accuracy: 0.9235 Epoch 21/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1981 - accuracy: 0.9355 - val_loss: 0.2014 - val_accuracy: 0.9383 Epoch 22/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1926 - accuracy: 0.9384 - val_loss: 0.1949 - val_accuracy: 0.9358 Epoch 23/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2078 - accuracy: 0.9340 - val_loss: 0.2213 - val_accuracy: 0.9347 Epoch 24/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2044 - accuracy: 0.9349 - val_loss: 0.2310 - val_accuracy: 0.9267 Epoch 25/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2015 - accuracy: 0.9352 - val_loss: 0.1994 - val_accuracy: 0.9398 Epoch 26/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2024 - accuracy: 0.9364 - val_loss: 0.2062 - val_accuracy: 0.9370 Epoch 27/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.2012 - accuracy: 0.9351 - val_loss: 0.2344 - val_accuracy: 0.9312 Epoch 28/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1931 - accuracy: 0.9393 - val_loss: 0.2054 - val_accuracy: 0.9332 Epoch 29/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1842 - accuracy: 0.9418 - val_loss: 0.1961 - val_accuracy: 0.9410 Epoch 30/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1859 - accuracy: 0.9416 - val_loss: 0.1900 - val_accuracy: 0.9375 Epoch 31/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.1905 - accuracy: 0.9392 - val_loss: 0.2091 - val_accuracy: 0.9377 Epoch 32/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1807 - accuracy: 0.9423 - val_loss: 0.1925 - val_accuracy: 0.9428 Epoch 33/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1790 - accuracy: 0.9426 - val_loss: 0.1797 - val_accuracy: 0.9453 Epoch 34/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1759 - accuracy: 0.9438 - val_loss: 0.1859 - val_accuracy: 0.9425 Epoch 35/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1751 - accuracy: 0.9440 - val_loss: 0.1891 - val_accuracy: 0.9405 Epoch 36/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1729 - accuracy: 0.9451 - val_loss: 0.1986 - val_accuracy: 0.9373 Epoch 37/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1748 - accuracy: 0.9446 - val_loss: 0.2004 - val_accuracy: 0.9383 Epoch 38/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1704 - accuracy: 0.9454 - val_loss: 0.1968 - val_accuracy: 0.9413 Epoch 39/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1769 - accuracy: 0.9433 - val_loss: 0.1932 - val_accuracy: 0.9398 Epoch 40/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1716 - accuracy: 0.9446 - val_loss: 0.1777 - val_accuracy: 0.9438 Epoch 41/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1717 - accuracy: 0.9449 - val_loss: 0.1790 - val_accuracy: 0.9455 Epoch 42/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1648 - accuracy: 0.9476 - val_loss: 0.1841 - val_accuracy: 0.9465 Epoch 43/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1696 - accuracy: 0.9445 - val_loss: 0.2060 - val_accuracy: 0.9417 Epoch 44/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1684 - accuracy: 0.9463 - val_loss: 0.1913 - val_accuracy: 0.9417 Epoch 45/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1722 - accuracy: 0.9451 - val_loss: 0.2023 - val_accuracy: 0.9408 Epoch 46/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1583 - accuracy: 0.9499 - val_loss: 0.1787 - val_accuracy: 0.9467 Epoch 47/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1706 - accuracy: 0.9450 - val_loss: 0.2004 - val_accuracy: 0.9413 Epoch 48/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1772 - accuracy: 0.9423 - val_loss: 0.1904 - val_accuracy: 0.9405 Epoch 49/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1845 - accuracy: 0.9418 - val_loss: 0.2161 - val_accuracy: 0.9340 Epoch 50/100 1125/1125 [==============================] - 6s 6ms/step - loss: 0.1947 - accuracy: 0.9382 - val_loss: 0.1919 - val_accuracy: 0.9402 563/563 [==============================] - 1s 2ms/step - loss: 0.2000 - accuracy: 0.9386 Epoch 1/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.5541 - accuracy: 0.8193 - val_loss: 0.4997 - val_accuracy: 0.8405 Epoch 2/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.4431 - accuracy: 0.8525 - val_loss: 0.4137 - val_accuracy: 0.8637 Epoch 3/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.4165 - accuracy: 0.8651 - val_loss: 0.3542 - val_accuracy: 0.8862 Epoch 4/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3634 - accuracy: 0.8819 - val_loss: 0.3331 - val_accuracy: 0.8947 Epoch 5/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3408 - accuracy: 0.8900 - val_loss: 0.3145 - val_accuracy: 0.8950 Epoch 6/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3350 - accuracy: 0.8916 - val_loss: 0.3173 - val_accuracy: 0.8955 Epoch 7/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3106 - accuracy: 0.8989 - val_loss: 0.3067 - val_accuracy: 0.8998 Epoch 8/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3011 - accuracy: 0.9033 - val_loss: 0.2719 - val_accuracy: 0.9152 Epoch 9/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2754 - accuracy: 0.9111 - val_loss: 0.2719 - val_accuracy: 0.9118 Epoch 10/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2808 - accuracy: 0.9086 - val_loss: 0.2807 - val_accuracy: 0.9100 Epoch 11/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2707 - accuracy: 0.9127 - val_loss: 0.2930 - val_accuracy: 0.9025 Epoch 12/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2773 - accuracy: 0.9078 - val_loss: 0.2804 - val_accuracy: 0.9120 Epoch 13/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2798 - accuracy: 0.9095 - val_loss: 0.2757 - val_accuracy: 0.9127 Epoch 14/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2759 - accuracy: 0.9114 - val_loss: 0.2638 - val_accuracy: 0.9173 Epoch 15/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2722 - accuracy: 0.9131 - val_loss: 0.2732 - val_accuracy: 0.9152 Epoch 16/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2626 - accuracy: 0.9141 - val_loss: 0.2715 - val_accuracy: 0.9117 Epoch 17/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2444 - accuracy: 0.9205 - val_loss: 0.2361 - val_accuracy: 0.9228 Epoch 18/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2391 - accuracy: 0.9234 - val_loss: 0.2319 - val_accuracy: 0.9278 Epoch 19/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2359 - accuracy: 0.9251 - val_loss: 0.2665 - val_accuracy: 0.9187 Epoch 20/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2316 - accuracy: 0.9257 - val_loss: 0.2451 - val_accuracy: 0.9225 Epoch 21/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2311 - accuracy: 0.9252 - val_loss: 0.2316 - val_accuracy: 0.9322 Epoch 22/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2261 - accuracy: 0.9286 - val_loss: 0.2319 - val_accuracy: 0.9260 Epoch 23/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2270 - accuracy: 0.9276 - val_loss: 0.2366 - val_accuracy: 0.9227 Epoch 24/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2189 - accuracy: 0.9294 - val_loss: 0.2316 - val_accuracy: 0.9288 Epoch 25/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2181 - accuracy: 0.9304 - val_loss: 0.2301 - val_accuracy: 0.9257 Epoch 26/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2150 - accuracy: 0.9298 - val_loss: 0.2355 - val_accuracy: 0.9280 Epoch 27/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2146 - accuracy: 0.9302 - val_loss: 0.2527 - val_accuracy: 0.9202 Epoch 28/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2191 - accuracy: 0.9303 - val_loss: 0.2038 - val_accuracy: 0.9355 Epoch 29/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2096 - accuracy: 0.9322 - val_loss: 0.2206 - val_accuracy: 0.9308 Epoch 30/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2034 - accuracy: 0.9348 - val_loss: 0.2077 - val_accuracy: 0.9352 Epoch 31/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2008 - accuracy: 0.9356 - val_loss: 0.2301 - val_accuracy: 0.9283 Epoch 32/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2098 - accuracy: 0.9333 - val_loss: 0.2189 - val_accuracy: 0.9358 Epoch 33/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2137 - accuracy: 0.9320 - val_loss: 0.2318 - val_accuracy: 0.9253 Epoch 34/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2071 - accuracy: 0.9328 - val_loss: 0.2364 - val_accuracy: 0.9267: 1s - loss: 0.2016 - accuracy: 0. - ETA: 0s - loss: 0.2 Epoch 35/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2050 - accuracy: 0.9345 - val_loss: 0.2149 - val_accuracy: 0.9312 Epoch 36/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2019 - accuracy: 0.9359 - val_loss: 0.2403 - val_accuracy: 0.9252 Epoch 37/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2091 - accuracy: 0.9329 - val_loss: 0.2157 - val_accuracy: 0.9350 Epoch 38/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2058 - accuracy: 0.9342 - val_loss: 0.2563 - val_accuracy: 0.9195 563/563 [==============================] - 1s 2ms/step - loss: 0.2577 - accuracy: 0.9194 Epoch 1/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.5791 - accuracy: 0.8094 - val_loss: 0.4132 - val_accuracy: 0.8652 Epoch 2/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.4222 - accuracy: 0.8639 - val_loss: 0.3468 - val_accuracy: 0.8848 Epoch 3/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3984 - accuracy: 0.8709 - val_loss: 0.3485 - val_accuracy: 0.8828 Epoch 4/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3636 - accuracy: 0.8810 - val_loss: 0.3116 - val_accuracy: 0.8955 Epoch 5/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3411 - accuracy: 0.8896 - val_loss: 0.3299 - val_accuracy: 0.8950 Epoch 6/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3128 - accuracy: 0.8990 - val_loss: 0.3061 - val_accuracy: 0.9045 Epoch 7/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3152 - accuracy: 0.8996 - val_loss: 0.3166 - val_accuracy: 0.8973 Epoch 8/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2833 - accuracy: 0.9089 - val_loss: 0.2552 - val_accuracy: 0.9222 Epoch 9/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2832 - accuracy: 0.9088 - val_loss: 0.2807 - val_accuracy: 0.9097 Epoch 10/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2710 - accuracy: 0.9118 - val_loss: 0.2772 - val_accuracy: 0.9120 Epoch 11/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2682 - accuracy: 0.9133 - val_loss: 0.2977 - val_accuracy: 0.9072 Epoch 12/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2703 - accuracy: 0.9122 - val_loss: 0.2919 - val_accuracy: 0.9093 Epoch 13/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2573 - accuracy: 0.9179 - val_loss: 0.2373 - val_accuracy: 0.9272 Epoch 14/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2534 - accuracy: 0.9191 - val_loss: 0.2364 - val_accuracy: 0.9243 Epoch 15/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2516 - accuracy: 0.9177 - val_loss: 0.2514 - val_accuracy: 0.9157 Epoch 16/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2556 - accuracy: 0.9160 - val_loss: 0.2598 - val_accuracy: 0.9158 Epoch 17/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2455 - accuracy: 0.9202 - val_loss: 0.2557 - val_accuracy: 0.9198 Epoch 18/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2359 - accuracy: 0.9219 - val_loss: 0.2453 - val_accuracy: 0.9202 Epoch 19/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2447 - accuracy: 0.9197 - val_loss: 0.2492 - val_accuracy: 0.9238 Epoch 20/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2192 - accuracy: 0.9282 - val_loss: 0.2369 - val_accuracy: 0.9300 Epoch 21/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2187 - accuracy: 0.9274 - val_loss: 0.2247 - val_accuracy: 0.9288 Epoch 22/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2210 - accuracy: 0.9302 - val_loss: 0.2624 - val_accuracy: 0.9172 Epoch 23/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2242 - accuracy: 0.9273 - val_loss: 0.2676 - val_accuracy: 0.9180 Epoch 24/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2303 - accuracy: 0.9261 - val_loss: 0.2158 - val_accuracy: 0.9323 Epoch 25/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2146 - accuracy: 0.9317 - val_loss: 0.2193 - val_accuracy: 0.9287 Epoch 26/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2072 - accuracy: 0.9331 - val_loss: 0.2383 - val_accuracy: 0.9235 Epoch 27/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2172 - accuracy: 0.9301 - val_loss: 0.2393 - val_accuracy: 0.9255 Epoch 28/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2223 - accuracy: 0.9277 - val_loss: 0.2202 - val_accuracy: 0.9310 Epoch 29/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2151 - accuracy: 0.9314 - val_loss: 0.2218 - val_accuracy: 0.9320 Epoch 30/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2074 - accuracy: 0.9331 - val_loss: 0.2284 - val_accuracy: 0.9263 Epoch 31/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2229 - accuracy: 0.9288 - val_loss: 0.2531 - val_accuracy: 0.9170 Epoch 32/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2199 - accuracy: 0.9281 - val_loss: 0.2489 - val_accuracy: 0.9208 Epoch 33/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2145 - accuracy: 0.9306 - val_loss: 0.2493 - val_accuracy: 0.9218 Epoch 34/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2090 - accuracy: 0.9319 - val_loss: 0.2290 - val_accuracy: 0.9283 563/563 [==============================] - 1s 2ms/step - loss: 0.2462 - accuracy: 0.9230 Epoch 1/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.5460 - accuracy: 0.8232 - val_loss: 0.4850 - val_accuracy: 0.8432 Epoch 2/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.4245 - accuracy: 0.8628 - val_loss: 0.4963 - val_accuracy: 0.8385 Epoch 3/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3847 - accuracy: 0.8739 - val_loss: 0.3523 - val_accuracy: 0.8870 Epoch 4/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3472 - accuracy: 0.8879 - val_loss: 0.3069 - val_accuracy: 0.9037 Epoch 5/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3285 - accuracy: 0.8942 - val_loss: 0.3375 - val_accuracy: 0.8957 Epoch 6/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3197 - accuracy: 0.8953 - val_loss: 0.3211 - val_accuracy: 0.8942 Epoch 7/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.3117 - accuracy: 0.8992 - val_loss: 0.2654 - val_accuracy: 0.9167 Epoch 8/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2972 - accuracy: 0.9049 - val_loss: 0.2758 - val_accuracy: 0.9095 Epoch 9/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2878 - accuracy: 0.9052 - val_loss: 0.2913 - val_accuracy: 0.9072 Epoch 10/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2876 - accuracy: 0.9075 - val_loss: 0.2625 - val_accuracy: 0.9162 Epoch 11/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2683 - accuracy: 0.9139 - val_loss: 0.2891 - val_accuracy: 0.9110 Epoch 12/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2681 - accuracy: 0.9136 - val_loss: 0.2905 - val_accuracy: 0.9047 Epoch 13/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2673 - accuracy: 0.9146 - val_loss: 0.2618 - val_accuracy: 0.9208 Epoch 14/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2448 - accuracy: 0.9214 - val_loss: 0.2571 - val_accuracy: 0.9210 Epoch 15/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2593 - accuracy: 0.9173 - val_loss: 0.2792 - val_accuracy: 0.9122 Epoch 16/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2601 - accuracy: 0.9161 - val_loss: 0.2556 - val_accuracy: 0.9200 Epoch 17/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2484 - accuracy: 0.9197 - val_loss: 0.2700 - val_accuracy: 0.9150 Epoch 18/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2505 - accuracy: 0.9190 - val_loss: 0.2632 - val_accuracy: 0.9193 Epoch 19/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2375 - accuracy: 0.9235 - val_loss: 0.2291 - val_accuracy: 0.9270 Epoch 20/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2407 - accuracy: 0.9220 - val_loss: 0.2486 - val_accuracy: 0.9218 Epoch 21/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2288 - accuracy: 0.9257 - val_loss: 0.2481 - val_accuracy: 0.9245 Epoch 22/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2185 - accuracy: 0.9288 - val_loss: 0.2341 - val_accuracy: 0.9277 Epoch 23/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2309 - accuracy: 0.9272 - val_loss: 0.2655 - val_accuracy: 0.9165 Epoch 24/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2352 - accuracy: 0.9247 - val_loss: 0.2722 - val_accuracy: 0.9127 Epoch 25/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2548 - accuracy: 0.9176 - val_loss: 0.2472 - val_accuracy: 0.9197 Epoch 26/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2363 - accuracy: 0.9239 - val_loss: 0.2599 - val_accuracy: 0.9172 Epoch 27/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2312 - accuracy: 0.9265 - val_loss: 0.2325 - val_accuracy: 0.9293 Epoch 28/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2138 - accuracy: 0.9312 - val_loss: 0.2404 - val_accuracy: 0.9250 Epoch 29/100 1125/1125 [==============================] - 5s 5ms/step - loss: 0.2188 - accuracy: 0.9298 - val_loss: 0.2451 - val_accuracy: 0.9198 563/563 [==============================] - 1s 2ms/step - loss: 0.2424 - accuracy: 0.9226 Epoch 1/100 1125/1125 [==============================] - 9s 7ms/step - loss: 0.7760 - accuracy: 0.8809 - val_loss: 0.3191 - val_accuracy: 0.9167 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2148 - accuracy: 0.9392 - val_loss: 0.2466 - val_accuracy: 0.9333 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1683 - accuracy: 0.9506 - val_loss: 0.1741 - val_accuracy: 0.9528 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1366 - accuracy: 0.9612 - val_loss: 0.1872 - val_accuracy: 0.9495 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1221 - accuracy: 0.9644 - val_loss: 0.2179 - val_accuracy: 0.9518 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1181 - accuracy: 0.9661 - val_loss: 0.1810 - val_accuracy: 0.9570 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1046 - accuracy: 0.9708 - val_loss: 0.1248 - val_accuracy: 0.9692 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0905 - accuracy: 0.9755 - val_loss: 0.1856 - val_accuracy: 0.9605 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0893 - accuracy: 0.9755 - val_loss: 0.1514 - val_accuracy: 0.9653 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0924 - accuracy: 0.9764 - val_loss: 0.2241 - val_accuracy: 0.9588 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0869 - accuracy: 0.9782 - val_loss: 0.1658 - val_accuracy: 0.9707 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0686 - accuracy: 0.9822 - val_loss: 0.1761 - val_accuracy: 0.9688 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0651 - accuracy: 0.9843 - val_loss: 0.1803 - val_accuracy: 0.9632 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0637 - accuracy: 0.9853 - val_loss: 0.1849 - val_accuracy: 0.9688 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0691 - accuracy: 0.9849 - val_loss: 0.2291 - val_accuracy: 0.9663 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0517 - accuracy: 0.9875 - val_loss: 0.1941 - val_accuracy: 0.9725 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0594 - accuracy: 0.9862 - val_loss: 0.1754 - val_accuracy: 0.9743 563/563 [==============================] - 1s 2ms/step - loss: 0.1750 - accuracy: 0.9727 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.8121 - accuracy: 0.8791 - val_loss: 0.2266 - val_accuracy: 0.9378 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2178 - accuracy: 0.9380 - val_loss: 0.1591 - val_accuracy: 0.9538 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1634 - accuracy: 0.9534 - val_loss: 0.1453 - val_accuracy: 0.9558 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1368 - accuracy: 0.9613 - val_loss: 0.1699 - val_accuracy: 0.9533 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1249 - accuracy: 0.9647 - val_loss: 0.1605 - val_accuracy: 0.9615 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1179 - accuracy: 0.9678 - val_loss: 0.1951 - val_accuracy: 0.9498 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1091 - accuracy: 0.9703 - val_loss: 0.1301 - val_accuracy: 0.9663 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0984 - accuracy: 0.9736 - val_loss: 0.1805 - val_accuracy: 0.9643 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0838 - accuracy: 0.9785 - val_loss: 0.1751 - val_accuracy: 0.9648 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0798 - accuracy: 0.9785 - val_loss: 0.1369 - val_accuracy: 0.9688 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0772 - accuracy: 0.9803 - val_loss: 0.1379 - val_accuracy: 0.9700 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0723 - accuracy: 0.9828 - val_loss: 0.1206 - val_accuracy: 0.9710 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0641 - accuracy: 0.9846 - val_loss: 0.1256 - val_accuracy: 0.9715 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0520 - accuracy: 0.9869 - val_loss: 0.1745 - val_accuracy: 0.9647 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0598 - accuracy: 0.9856 - val_loss: 0.1465 - val_accuracy: 0.9698 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0528 - accuracy: 0.9870 - val_loss: 0.1646 - val_accuracy: 0.9703 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0553 - accuracy: 0.9872 - val_loss: 0.2018 - val_accuracy: 0.9710 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0432 - accuracy: 0.9901 - val_loss: 0.1151 - val_accuracy: 0.9767 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0651 - accuracy: 0.9859 - val_loss: 0.1979 - val_accuracy: 0.9738 Epoch 20/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0556 - accuracy: 0.9877 - val_loss: 0.1706 - val_accuracy: 0.9750 Epoch 21/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0466 - accuracy: 0.9891 - val_loss: 0.1625 - val_accuracy: 0.9753 Epoch 22/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0404 - accuracy: 0.9907 - val_loss: 0.3043 - val_accuracy: 0.9677 Epoch 23/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0258 - accuracy: 0.9934 - val_loss: 0.2306 - val_accuracy: 0.9713 Epoch 24/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0373 - accuracy: 0.9914 - val_loss: 0.3415 - val_accuracy: 0.9737 Epoch 25/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0622 - accuracy: 0.9884 - val_loss: 0.1636 - val_accuracy: 0.9782 Epoch 26/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0318 - accuracy: 0.9931 - val_loss: 0.1597 - val_accuracy: 0.9760 Epoch 27/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0316 - accuracy: 0.9935 - val_loss: 0.2753 - val_accuracy: 0.9758 Epoch 28/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0416 - accuracy: 0.9924 - val_loss: 0.2163 - val_accuracy: 0.9767 563/563 [==============================] - 1s 2ms/step - loss: 0.2218 - accuracy: 0.9748 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.9116 - accuracy: 0.8798 - val_loss: 0.2655 - val_accuracy: 0.9320 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2144 - accuracy: 0.9401 - val_loss: 0.2065 - val_accuracy: 0.9412 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1643 - accuracy: 0.9543 - val_loss: 0.2032 - val_accuracy: 0.9450 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1432 - accuracy: 0.9597 - val_loss: 0.1728 - val_accuracy: 0.9542 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1225 - accuracy: 0.9653 - val_loss: 0.1779 - val_accuracy: 0.9583 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1162 - accuracy: 0.9691 - val_loss: 0.1728 - val_accuracy: 0.9572 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1048 - accuracy: 0.9720 - val_loss: 0.1328 - val_accuracy: 0.9622 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1039 - accuracy: 0.9732 - val_loss: 0.1773 - val_accuracy: 0.9585 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0852 - accuracy: 0.9774 - val_loss: 0.1306 - val_accuracy: 0.9653 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0788 - accuracy: 0.9797 - val_loss: 0.1408 - val_accuracy: 0.9668 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0787 - accuracy: 0.9796 - val_loss: 0.1528 - val_accuracy: 0.9645 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0772 - accuracy: 0.9810 - val_loss: 0.1452 - val_accuracy: 0.9678 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0572 - accuracy: 0.9856 - val_loss: 0.1403 - val_accuracy: 0.9732 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0549 - accuracy: 0.9861 - val_loss: 0.1531 - val_accuracy: 0.9715 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0715 - accuracy: 0.9840 - val_loss: 0.1767 - val_accuracy: 0.9660 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0606 - accuracy: 0.9862 - val_loss: 0.1654 - val_accuracy: 0.9678 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0441 - accuracy: 0.9892 - val_loss: 0.1515 - val_accuracy: 0.9732 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0567 - accuracy: 0.9867 - val_loss: 0.2295 - val_accuracy: 0.9703 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.0716 - accuracy: 0.9861 - val_loss: 0.1436 - val_accuracy: 0.9728 563/563 [==============================] - 1s 2ms/step - loss: 0.1607 - accuracy: 0.9723 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.4959 - accuracy: 0.8401 - val_loss: 0.4333 - val_accuracy: 0.8533 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3775 - accuracy: 0.8770 - val_loss: 0.3322 - val_accuracy: 0.8965 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3477 - accuracy: 0.8884 - val_loss: 0.2806 - val_accuracy: 0.9103 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3321 - accuracy: 0.8921 - val_loss: 0.3188 - val_accuracy: 0.8920 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3006 - accuracy: 0.9028 - val_loss: 0.2979 - val_accuracy: 0.9033 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2826 - accuracy: 0.9086 - val_loss: 0.2560 - val_accuracy: 0.9115 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2585 - accuracy: 0.9171 - val_loss: 0.2512 - val_accuracy: 0.9172 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2552 - accuracy: 0.9179 - val_loss: 0.2816 - val_accuracy: 0.9073 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2498 - accuracy: 0.9197 - val_loss: 0.2349 - val_accuracy: 0.9247 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2462 - accuracy: 0.9208 - val_loss: 0.2709 - val_accuracy: 0.9145 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2391 - accuracy: 0.9231 - val_loss: 0.2162 - val_accuracy: 0.9322 Epoch 12/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2189 - accuracy: 0.9291 - val_loss: 0.2086 - val_accuracy: 0.9327 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2217 - accuracy: 0.9298 - val_loss: 0.2345 - val_accuracy: 0.9272 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2219 - accuracy: 0.9300 - val_loss: 0.2489 - val_accuracy: 0.9242 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2308 - accuracy: 0.9267 - val_loss: 0.2583 - val_accuracy: 0.9157 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2400 - accuracy: 0.9256 - val_loss: 0.2595 - val_accuracy: 0.9202 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2341 - accuracy: 0.9259 - val_loss: 0.2313 - val_accuracy: 0.9277 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2217 - accuracy: 0.9278 - val_loss: 0.2297 - val_accuracy: 0.9268 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2121 - accuracy: 0.9316 - val_loss: 0.2036 - val_accuracy: 0.9353 Epoch 20/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2113 - accuracy: 0.9319 - val_loss: 0.2234 - val_accuracy: 0.9337 Epoch 21/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2145 - accuracy: 0.9318 - val_loss: 0.2158 - val_accuracy: 0.9330 Epoch 22/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2141 - accuracy: 0.9317 - val_loss: 0.2219 - val_accuracy: 0.9290 Epoch 23/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2186 - accuracy: 0.9315 - val_loss: 0.2163 - val_accuracy: 0.9322 Epoch 24/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2051 - accuracy: 0.9344 - val_loss: 0.2163 - val_accuracy: 0.9333 Epoch 25/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2004 - accuracy: 0.9366 - val_loss: 0.1982 - val_accuracy: 0.9385 Epoch 26/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2030 - accuracy: 0.9361 - val_loss: 0.1977 - val_accuracy: 0.9370 Epoch 27/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2096 - accuracy: 0.9331 - val_loss: 0.2100 - val_accuracy: 0.9350 Epoch 28/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2018 - accuracy: 0.9369 - val_loss: 0.2307 - val_accuracy: 0.9295 Epoch 29/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2036 - accuracy: 0.9358 - val_loss: 0.2231 - val_accuracy: 0.9332 Epoch 30/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2045 - accuracy: 0.9351 - val_loss: 0.2274 - val_accuracy: 0.9275 Epoch 31/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2089 - accuracy: 0.9347 - val_loss: 0.2090 - val_accuracy: 0.9335 Epoch 32/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2055 - accuracy: 0.9349 - val_loss: 0.2033 - val_accuracy: 0.9380 Epoch 33/100 1125/1125 [==============================] - 7s 6ms/step - loss: 0.2163 - accuracy: 0.9313 - val_loss: 0.2215 - val_accuracy: 0.9320 Epoch 34/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2118 - accuracy: 0.9334 - val_loss: 0.2013 - val_accuracy: 0.9368 Epoch 35/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2063 - accuracy: 0.9350 - val_loss: 0.2030 - val_accuracy: 0.9388 Epoch 36/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2012 - accuracy: 0.9369 - val_loss: 0.2210 - val_accuracy: 0.9272 563/563 [==============================] - 1s 2ms/step - loss: 0.2322 - accuracy: 0.9259 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.5001 - accuracy: 0.8393 - val_loss: 0.3934 - val_accuracy: 0.8670 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3676 - accuracy: 0.8817 - val_loss: 0.3237 - val_accuracy: 0.8988 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3299 - accuracy: 0.8935 - val_loss: 0.3649 - val_accuracy: 0.8752 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3060 - accuracy: 0.9010 - val_loss: 0.2685 - val_accuracy: 0.9147 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2769 - accuracy: 0.9105 - val_loss: 0.2577 - val_accuracy: 0.9177 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2826 - accuracy: 0.9069 - val_loss: 0.3217 - val_accuracy: 0.8990 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2696 - accuracy: 0.9134 - val_loss: 0.2607 - val_accuracy: 0.9137 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2778 - accuracy: 0.9077 - val_loss: 0.2897 - val_accuracy: 0.9042 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2534 - accuracy: 0.9180 - val_loss: 0.2629 - val_accuracy: 0.9122 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2372 - accuracy: 0.9243 - val_loss: 0.2227 - val_accuracy: 0.9270 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2255 - accuracy: 0.9292 - val_loss: 0.2314 - val_accuracy: 0.9247 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2226 - accuracy: 0.9287 - val_loss: 0.2540 - val_accuracy: 0.9207 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2241 - accuracy: 0.9288 - val_loss: 0.2206 - val_accuracy: 0.9287 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2210 - accuracy: 0.9281 - val_loss: 0.2345 - val_accuracy: 0.9250 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2224 - accuracy: 0.9285 - val_loss: 0.2259 - val_accuracy: 0.9270 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2157 - accuracy: 0.9300 - val_loss: 0.2760 - val_accuracy: 0.9072 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2283 - accuracy: 0.9264 - val_loss: 0.2122 - val_accuracy: 0.9358 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2174 - accuracy: 0.9307 - val_loss: 0.2043 - val_accuracy: 0.9360 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2050 - accuracy: 0.9348 - val_loss: 0.2140 - val_accuracy: 0.9340 Epoch 20/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2130 - accuracy: 0.9296 - val_loss: 0.2267 - val_accuracy: 0.9292 Epoch 21/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2071 - accuracy: 0.9335 - val_loss: 0.2007 - val_accuracy: 0.9398 Epoch 22/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2079 - accuracy: 0.9321 - val_loss: 0.2129 - val_accuracy: 0.9355 Epoch 23/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2058 - accuracy: 0.9342 - val_loss: 0.2006 - val_accuracy: 0.9393 Epoch 24/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2053 - accuracy: 0.9353 - val_loss: 0.2141 - val_accuracy: 0.9315 Epoch 25/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2045 - accuracy: 0.9344 - val_loss: 0.2270 - val_accuracy: 0.9307 Epoch 26/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1984 - accuracy: 0.9359 - val_loss: 0.2005 - val_accuracy: 0.9363 Epoch 27/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1937 - accuracy: 0.9389 - val_loss: 0.2134 - val_accuracy: 0.9350 Epoch 28/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1955 - accuracy: 0.9365 - val_loss: 0.2021 - val_accuracy: 0.9368 Epoch 29/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1971 - accuracy: 0.9381 - val_loss: 0.2175 - val_accuracy: 0.9303 Epoch 30/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1900 - accuracy: 0.9391 - val_loss: 0.1772 - val_accuracy: 0.9447 Epoch 31/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1871 - accuracy: 0.9403 - val_loss: 0.2296 - val_accuracy: 0.9323 Epoch 32/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1916 - accuracy: 0.9387 - val_loss: 0.1974 - val_accuracy: 0.9393 Epoch 33/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1919 - accuracy: 0.9388 - val_loss: 0.1942 - val_accuracy: 0.9397 Epoch 34/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1934 - accuracy: 0.9379 - val_loss: 0.2072 - val_accuracy: 0.9362 Epoch 35/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1888 - accuracy: 0.9399 - val_loss: 0.2213 - val_accuracy: 0.9305 Epoch 36/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1933 - accuracy: 0.9382 - val_loss: 0.1979 - val_accuracy: 0.9403 Epoch 37/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1921 - accuracy: 0.9383 - val_loss: 0.1922 - val_accuracy: 0.9397 Epoch 38/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2044 - accuracy: 0.9348 - val_loss: 0.2251 - val_accuracy: 0.9287 Epoch 39/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1987 - accuracy: 0.9376 - val_loss: 0.2057 - val_accuracy: 0.9348 Epoch 40/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1879 - accuracy: 0.9408 - val_loss: 0.1996 - val_accuracy: 0.9393 563/563 [==============================] - 1s 2ms/step - loss: 0.2170 - accuracy: 0.9351 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.5129 - accuracy: 0.8358 - val_loss: 0.3782 - val_accuracy: 0.8770 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3805 - accuracy: 0.8772 - val_loss: 0.3431 - val_accuracy: 0.8805 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3402 - accuracy: 0.8909 - val_loss: 0.3290 - val_accuracy: 0.8942 Epoch 4/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2975 - accuracy: 0.9045 - val_loss: 0.2780 - val_accuracy: 0.9105 Epoch 5/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2767 - accuracy: 0.9103 - val_loss: 0.2380 - val_accuracy: 0.9247 Epoch 6/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2824 - accuracy: 0.9079 - val_loss: 0.2969 - val_accuracy: 0.9010 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2719 - accuracy: 0.9115 - val_loss: 0.2506 - val_accuracy: 0.9208 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2552 - accuracy: 0.9180 - val_loss: 0.2322 - val_accuracy: 0.9267 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2448 - accuracy: 0.9222 - val_loss: 0.2159 - val_accuracy: 0.9325 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2408 - accuracy: 0.9234 - val_loss: 0.2720 - val_accuracy: 0.9143 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2314 - accuracy: 0.9262 - val_loss: 0.2222 - val_accuracy: 0.9312 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2319 - accuracy: 0.9254 - val_loss: 0.2446 - val_accuracy: 0.9203 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2236 - accuracy: 0.9283 - val_loss: 0.2484 - val_accuracy: 0.9247.2225 - accu Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2276 - accuracy: 0.9269 - val_loss: 0.2296 - val_accuracy: 0.9252 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2192 - accuracy: 0.9304 - val_loss: 0.2225 - val_accuracy: 0.9290 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2145 - accuracy: 0.9331 - val_loss: 0.2053 - val_accuracy: 0.9362 Epoch 17/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2080 - accuracy: 0.9345 - val_loss: 0.1986 - val_accuracy: 0.9360 Epoch 18/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2104 - accuracy: 0.9333 - val_loss: 0.2102 - val_accuracy: 0.9307 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2105 - accuracy: 0.9337 - val_loss: 0.2340 - val_accuracy: 0.9247 Epoch 20/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2141 - accuracy: 0.9315 - val_loss: 0.2011 - val_accuracy: 0.9345 Epoch 21/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2054 - accuracy: 0.9353 - val_loss: 0.2198 - val_accuracy: 0.9313 Epoch 22/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2040 - accuracy: 0.9359 - val_loss: 0.2168 - val_accuracy: 0.9348 Epoch 23/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2041 - accuracy: 0.9339 - val_loss: 0.2247 - val_accuracy: 0.9298 Epoch 24/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2125 - accuracy: 0.9321 - val_loss: 0.2049 - val_accuracy: 0.9350 Epoch 25/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2083 - accuracy: 0.9343 - val_loss: 0.2350 - val_accuracy: 0.9240 Epoch 26/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.2140 - accuracy: 0.9324 - val_loss: 0.1976 - val_accuracy: 0.9378 Epoch 27/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1991 - accuracy: 0.9363 - val_loss: 0.1932 - val_accuracy: 0.9388 Epoch 28/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1988 - accuracy: 0.9381 - val_loss: 0.2238 - val_accuracy: 0.9348 Epoch 29/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1951 - accuracy: 0.9387 - val_loss: 0.2112 - val_accuracy: 0.9357 Epoch 30/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1988 - accuracy: 0.9374 - val_loss: 0.2236 - val_accuracy: 0.9298 Epoch 31/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2003 - accuracy: 0.9366 - val_loss: 0.2155 - val_accuracy: 0.9327 Epoch 32/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1950 - accuracy: 0.9377 - val_loss: 0.2107 - val_accuracy: 0.9340 Epoch 33/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1925 - accuracy: 0.9399 - val_loss: 0.1882 - val_accuracy: 0.9398 Epoch 34/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1898 - accuracy: 0.9387 - val_loss: 0.1942 - val_accuracy: 0.9395 Epoch 35/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1930 - accuracy: 0.9380 - val_loss: 0.1945 - val_accuracy: 0.9393 Epoch 36/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1909 - accuracy: 0.9388 - val_loss: 0.2040 - val_accuracy: 0.9360 Epoch 37/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1918 - accuracy: 0.9388 - val_loss: 0.2225 - val_accuracy: 0.9295 Epoch 38/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1891 - accuracy: 0.9400 - val_loss: 0.1904 - val_accuracy: 0.9450 Epoch 39/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1884 - accuracy: 0.9414 - val_loss: 0.1993 - val_accuracy: 0.9407 0.1877 - accu Epoch 40/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1879 - accuracy: 0.9400 - val_loss: 0.1804 - val_accuracy: 0.9447 Epoch 41/100 1125/1125 [==============================] - 7s 7ms/step - loss: 0.1851 - accuracy: 0.9414 - val_loss: 0.1947 - val_accuracy: 0.9390 Epoch 42/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1865 - accuracy: 0.9406 - val_loss: 0.2060 - val_accuracy: 0.9378 Epoch 43/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1915 - accuracy: 0.9396 - val_loss: 0.2167 - val_accuracy: 0.9348 Epoch 44/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1812 - accuracy: 0.9436 - val_loss: 0.1998 - val_accuracy: 0.9402 Epoch 45/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1890 - accuracy: 0.9411 - val_loss: 0.2320 - val_accuracy: 0.9280 Epoch 46/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1941 - accuracy: 0.9386 - val_loss: 0.2065 - val_accuracy: 0.9370 Epoch 47/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1883 - accuracy: 0.9403 - val_loss: 0.2223 - val_accuracy: 0.9268 Epoch 48/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1858 - accuracy: 0.9423 - val_loss: 0.2138 - val_accuracy: 0.9343 Epoch 49/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1920 - accuracy: 0.9398 - val_loss: 0.2055 - val_accuracy: 0.9338 Epoch 50/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1853 - accuracy: 0.9412 - val_loss: 0.1946 - val_accuracy: 0.9395 563/563 [==============================] - 1s 2ms/step - loss: 0.2016 - accuracy: 0.9394 Epoch 1/100 1125/1125 [==============================] - 5s 4ms/step - loss: 1.2563 - accuracy: 0.8666 - val_loss: 0.4250 - val_accuracy: 0.8948 Epoch 2/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.2550 - accuracy: 0.9340 - val_loss: 0.2508 - val_accuracy: 0.9335 Epoch 3/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1874 - accuracy: 0.9489 - val_loss: 0.2030 - val_accuracy: 0.9457 Epoch 4/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1557 - accuracy: 0.9561 - val_loss: 0.2212 - val_accuracy: 0.9487 Epoch 5/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1435 - accuracy: 0.9597 - val_loss: 0.2427 - val_accuracy: 0.9400 Epoch 6/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1336 - accuracy: 0.9623 - val_loss: 0.2530 - val_accuracy: 0.9390 Epoch 7/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1133 - accuracy: 0.9682 - val_loss: 0.1771 - val_accuracy: 0.9558 Epoch 8/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1097 - accuracy: 0.9694 - val_loss: 0.1626 - val_accuracy: 0.9603 Epoch 9/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0994 - accuracy: 0.9718 - val_loss: 0.1682 - val_accuracy: 0.9563 Epoch 10/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0878 - accuracy: 0.9759 - val_loss: 0.1704 - val_accuracy: 0.9588 Epoch 11/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0762 - accuracy: 0.9779 - val_loss: 0.2258 - val_accuracy: 0.9592 Epoch 12/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0728 - accuracy: 0.9800 - val_loss: 0.2161 - val_accuracy: 0.9525 Epoch 13/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0814 - accuracy: 0.9792 - val_loss: 0.1576 - val_accuracy: 0.9643 Epoch 14/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0625 - accuracy: 0.9827 - val_loss: 0.1926 - val_accuracy: 0.9702 Epoch 15/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0631 - accuracy: 0.9845 - val_loss: 0.1497 - val_accuracy: 0.9730 Epoch 16/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0484 - accuracy: 0.9876 - val_loss: 0.1988 - val_accuracy: 0.9650 Epoch 17/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0598 - accuracy: 0.9854 - val_loss: 0.2509 - val_accuracy: 0.9597 Epoch 18/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0594 - accuracy: 0.9844 - val_loss: 0.1762 - val_accuracy: 0.9670 Epoch 19/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0409 - accuracy: 0.9894 - val_loss: 0.1799 - val_accuracy: 0.9703 Epoch 20/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0456 - accuracy: 0.9889 - val_loss: 0.1856 - val_accuracy: 0.9703 Epoch 21/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0501 - accuracy: 0.9884 - val_loss: 0.1777 - val_accuracy: 0.9658 Epoch 22/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0576 - accuracy: 0.9871 - val_loss: 0.2159 - val_accuracy: 0.9710 Epoch 23/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0473 - accuracy: 0.9894 - val_loss: 0.1644 - val_accuracy: 0.9740 Epoch 24/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0335 - accuracy: 0.9920 - val_loss: 0.2052 - val_accuracy: 0.9732 Epoch 25/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0446 - accuracy: 0.9898 - val_loss: 0.2506 - val_accuracy: 0.9698 563/563 [==============================] - 1s 2ms/step - loss: 0.2648 - accuracy: 0.9676 Epoch 1/100 1125/1125 [==============================] - 5s 4ms/step - loss: 1.4413 - accuracy: 0.8638 - val_loss: 0.3086 - val_accuracy: 0.9235 Epoch 2/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.2339 - accuracy: 0.9356 - val_loss: 0.2424 - val_accuracy: 0.9418 Epoch 3/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1826 - accuracy: 0.9496 - val_loss: 0.2254 - val_accuracy: 0.9442 Epoch 4/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1583 - accuracy: 0.9551 - val_loss: 0.1797 - val_accuracy: 0.9573 Epoch 5/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1378 - accuracy: 0.9614 - val_loss: 0.2111 - val_accuracy: 0.9477 Epoch 6/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1241 - accuracy: 0.9647 - val_loss: 0.1633 - val_accuracy: 0.9562 Epoch 7/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1149 - accuracy: 0.9675 - val_loss: 0.1742 - val_accuracy: 0.9557 Epoch 8/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1083 - accuracy: 0.9698 - val_loss: 0.1377 - val_accuracy: 0.9645 Epoch 9/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0943 - accuracy: 0.9745 - val_loss: 0.1718 - val_accuracy: 0.9565 Epoch 10/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0872 - accuracy: 0.9765 - val_loss: 0.1505 - val_accuracy: 0.9658 Epoch 11/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0806 - accuracy: 0.9787 - val_loss: 0.1577 - val_accuracy: 0.9655 Epoch 12/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0783 - accuracy: 0.9787 - val_loss: 0.1488 - val_accuracy: 0.9673 Epoch 13/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0678 - accuracy: 0.9813 - val_loss: 0.1700 - val_accuracy: 0.9632 Epoch 14/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0619 - accuracy: 0.9837 - val_loss: 0.1954 - val_accuracy: 0.9605 Epoch 15/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0614 - accuracy: 0.9844 - val_loss: 0.1597 - val_accuracy: 0.9647 Epoch 16/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0589 - accuracy: 0.9844 - val_loss: 0.1531 - val_accuracy: 0.9730 Epoch 17/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0702 - accuracy: 0.9833 - val_loss: 0.1546 - val_accuracy: 0.9703 Epoch 18/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0636 - accuracy: 0.9852 - val_loss: 0.1506 - val_accuracy: 0.9718 563/563 [==============================] - 1s 2ms/step - loss: 0.2064 - accuracy: 0.9661 Epoch 1/100 1125/1125 [==============================] - 5s 4ms/step - loss: 1.2812 - accuracy: 0.8598 - val_loss: 0.4537 - val_accuracy: 0.9035 Epoch 2/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.2849 - accuracy: 0.9283 - val_loss: 0.2866 - val_accuracy: 0.9313 Epoch 3/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.2065 - accuracy: 0.9451 - val_loss: 0.2321 - val_accuracy: 0.9383 Epoch 4/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1723 - accuracy: 0.9506 - val_loss: 0.1743 - val_accuracy: 0.9560 Epoch 5/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1393 - accuracy: 0.9610 - val_loss: 0.1834 - val_accuracy: 0.9537 Epoch 6/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1268 - accuracy: 0.9649 - val_loss: 0.1954 - val_accuracy: 0.9483 Epoch 7/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1216 - accuracy: 0.9664 - val_loss: 0.1846 - val_accuracy: 0.9513 Epoch 8/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1087 - accuracy: 0.9699 - val_loss: 0.1584 - val_accuracy: 0.9615 Epoch 9/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.1069 - accuracy: 0.9715 - val_loss: 0.1530 - val_accuracy: 0.9633 Epoch 10/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0937 - accuracy: 0.9751 - val_loss: 0.1699 - val_accuracy: 0.9585 Epoch 11/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0872 - accuracy: 0.9765 - val_loss: 0.1805 - val_accuracy: 0.9592 Epoch 12/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0776 - accuracy: 0.9790 - val_loss: 0.1708 - val_accuracy: 0.9643 Epoch 13/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0744 - accuracy: 0.9794 - val_loss: 0.1951 - val_accuracy: 0.9625 Epoch 14/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0701 - accuracy: 0.9814 - val_loss: 0.1707 - val_accuracy: 0.9645 Epoch 15/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0705 - accuracy: 0.9824 - val_loss: 0.1494 - val_accuracy: 0.9683 Epoch 16/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0566 - accuracy: 0.9843 - val_loss: 0.1842 - val_accuracy: 0.9655 Epoch 17/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0750 - accuracy: 0.9830 - val_loss: 0.1351 - val_accuracy: 0.9718 Epoch 18/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0479 - accuracy: 0.9875 - val_loss: 0.1943 - val_accuracy: 0.9585 Epoch 19/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0443 - accuracy: 0.9881 - val_loss: 0.2319 - val_accuracy: 0.9657 Epoch 20/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0693 - accuracy: 0.9839 - val_loss: 0.1699 - val_accuracy: 0.9702 Epoch 21/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0435 - accuracy: 0.9886 - val_loss: 0.1515 - val_accuracy: 0.9718 Epoch 22/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0387 - accuracy: 0.9904 - val_loss: 0.1846 - val_accuracy: 0.9657 Epoch 23/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0558 - accuracy: 0.9869 - val_loss: 0.2083 - val_accuracy: 0.9712 Epoch 24/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0571 - accuracy: 0.9882 - val_loss: 0.1834 - val_accuracy: 0.9722 Epoch 25/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0478 - accuracy: 0.9899 - val_loss: 0.1650 - val_accuracy: 0.9693 Epoch 26/100 1125/1125 [==============================] - 4s 4ms/step - loss: 0.0402 - accuracy: 0.9902 - val_loss: 0.1982 - val_accuracy: 0.9703 Epoch 27/100 1125/1125 [==============================] - 5s 4ms/step - loss: 0.0282 - accuracy: 0.9927 - val_loss: 0.2004 - val_accuracy: 0.9708 563/563 [==============================] - 1s 2ms/step - loss: 0.2045 - accuracy: 0.9698 Epoch 1/100 1125/1125 [==============================] - 9s 7ms/step - loss: 0.5267 - accuracy: 0.8278 - val_loss: 0.3800 - val_accuracy: 0.8737 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.4061 - accuracy: 0.8687 - val_loss: 0.3512 - val_accuracy: 0.8893 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3680 - accuracy: 0.8820 - val_loss: 0.3166 - val_accuracy: 0.8982 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3270 - accuracy: 0.8952 - val_loss: 0.3235 - val_accuracy: 0.8952 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3099 - accuracy: 0.8986 - val_loss: 0.3066 - val_accuracy: 0.9035 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2968 - accuracy: 0.9044 - val_loss: 0.3273 - val_accuracy: 0.8940 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2826 - accuracy: 0.9079 - val_loss: 0.3894 - val_accuracy: 0.8687 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2996 - accuracy: 0.9026 - val_loss: 0.2918 - val_accuracy: 0.9073 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2795 - accuracy: 0.9091 - val_loss: 0.3408 - val_accuracy: 0.8900 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2686 - accuracy: 0.9133 - val_loss: 0.2870 - val_accuracy: 0.9063 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2661 - accuracy: 0.9145 - val_loss: 0.2409 - val_accuracy: 0.9247 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2536 - accuracy: 0.9177 - val_loss: 0.2500 - val_accuracy: 0.9223 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2457 - accuracy: 0.9215 - val_loss: 0.2672 - val_accuracy: 0.9133 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2373 - accuracy: 0.9236 - val_loss: 0.2678 - val_accuracy: 0.9170 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2328 - accuracy: 0.9248 - val_loss: 0.2301 - val_accuracy: 0.9303 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2167 - accuracy: 0.9311 - val_loss: 0.2123 - val_accuracy: 0.9318 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2211 - accuracy: 0.9297 - val_loss: 0.2216 - val_accuracy: 0.9302 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2179 - accuracy: 0.9309 - val_loss: 0.2360 - val_accuracy: 0.9250 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2191 - accuracy: 0.9302 - val_loss: 0.2336 - val_accuracy: 0.9292 Epoch 20/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2221 - accuracy: 0.9284 - val_loss: 0.2218 - val_accuracy: 0.9317 Epoch 21/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2185 - accuracy: 0.9289 - val_loss: 0.2256 - val_accuracy: 0.9292 Epoch 22/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2219 - accuracy: 0.9298 - val_loss: 0.2463 - val_accuracy: 0.9200 Epoch 23/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2173 - accuracy: 0.9292 - val_loss: 0.2258 - val_accuracy: 0.9303 Epoch 24/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2145 - accuracy: 0.9306 - val_loss: 0.2494 - val_accuracy: 0.9225 Epoch 25/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2166 - accuracy: 0.9302 - val_loss: 0.2392 - val_accuracy: 0.9280 Epoch 26/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2278 - accuracy: 0.9258 - val_loss: 0.2424 - val_accuracy: 0.9245 563/563 [==============================] - 1s 2ms/step - loss: 0.2468 - accuracy: 0.9258 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.5309 - accuracy: 0.8287 - val_loss: 0.4069 - val_accuracy: 0.8645 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.4038 - accuracy: 0.8684 - val_loss: 0.3397 - val_accuracy: 0.8952 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3565 - accuracy: 0.8838 - val_loss: 0.3671 - val_accuracy: 0.8830 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3487 - accuracy: 0.8873 - val_loss: 0.2903 - val_accuracy: 0.9047 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3177 - accuracy: 0.8984 - val_loss: 0.3025 - val_accuracy: 0.8973 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3022 - accuracy: 0.9030 - val_loss: 0.2604 - val_accuracy: 0.9158 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2985 - accuracy: 0.9036 - val_loss: 0.3226 - val_accuracy: 0.8995 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2904 - accuracy: 0.9068 - val_loss: 0.3575 - val_accuracy: 0.8798 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2693 - accuracy: 0.9124 - val_loss: 0.2552 - val_accuracy: 0.9182 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2593 - accuracy: 0.9161 - val_loss: 0.2798 - val_accuracy: 0.9112 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2524 - accuracy: 0.9177 - val_loss: 0.2581 - val_accuracy: 0.9182 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2643 - accuracy: 0.9147 - val_loss: 0.2571 - val_accuracy: 0.9193 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2567 - accuracy: 0.9172 - val_loss: 0.2822 - val_accuracy: 0.9080 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2417 - accuracy: 0.9219 - val_loss: 0.2357 - val_accuracy: 0.9235 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2391 - accuracy: 0.9233 - val_loss: 0.2554 - val_accuracy: 0.9242 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2289 - accuracy: 0.9256 - val_loss: 0.2572 - val_accuracy: 0.9242 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2321 - accuracy: 0.9263 - val_loss: 0.2543 - val_accuracy: 0.9185 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2456 - accuracy: 0.9209 - val_loss: 0.2485 - val_accuracy: 0.9203 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2325 - accuracy: 0.9243 - val_loss: 0.2420 - val_accuracy: 0.9213 Epoch 20/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2222 - accuracy: 0.9282 - val_loss: 0.2328 - val_accuracy: 0.9262 Epoch 21/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2087 - accuracy: 0.9347 - val_loss: 0.2173 - val_accuracy: 0.9282 Epoch 22/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2110 - accuracy: 0.9337 - val_loss: 0.2113 - val_accuracy: 0.9355 Epoch 23/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2220 - accuracy: 0.9294 - val_loss: 0.2404 - val_accuracy: 0.9293 Epoch 24/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2196 - accuracy: 0.9289 - val_loss: 0.2475 - val_accuracy: 0.9218 Epoch 25/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2189 - accuracy: 0.9297 - val_loss: 0.2280 - val_accuracy: 0.9302 Epoch 26/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2199 - accuracy: 0.9298 - val_loss: 0.2110 - val_accuracy: 0.9347 Epoch 27/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2066 - accuracy: 0.9341 - val_loss: 0.2329 - val_accuracy: 0.9287 Epoch 28/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2043 - accuracy: 0.9358 - val_loss: 0.2216 - val_accuracy: 0.9328 Epoch 29/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2098 - accuracy: 0.9329 - val_loss: 0.2378 - val_accuracy: 0.9272 Epoch 30/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2147 - accuracy: 0.9323 - val_loss: 0.2099 - val_accuracy: 0.9338 Epoch 31/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2114 - accuracy: 0.9312 - val_loss: 0.2248 - val_accuracy: 0.9352 Epoch 32/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2109 - accuracy: 0.9331 - val_loss: 0.2043 - val_accuracy: 0.9375 Epoch 33/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2014 - accuracy: 0.9359 - val_loss: 0.2233 - val_accuracy: 0.9293 Epoch 34/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2108 - accuracy: 0.9333 - val_loss: 0.2295 - val_accuracy: 0.9282 Epoch 35/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2049 - accuracy: 0.9326 - val_loss: 0.2183 - val_accuracy: 0.9382 Epoch 36/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1991 - accuracy: 0.9354 - val_loss: 0.2308 - val_accuracy: 0.9290 Epoch 37/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2048 - accuracy: 0.9364 - val_loss: 0.2048 - val_accuracy: 0.9365 Epoch 38/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2021 - accuracy: 0.9358 - val_loss: 0.2136 - val_accuracy: 0.9345 Epoch 39/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2070 - accuracy: 0.9339 - val_loss: 0.2133 - val_accuracy: 0.9302 Epoch 40/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2170 - accuracy: 0.9297 - val_loss: 0.2086 - val_accuracy: 0.9342 Epoch 41/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2128 - accuracy: 0.9316 - val_loss: 0.2319 - val_accuracy: 0.9287 Epoch 42/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2018 - accuracy: 0.9351 - val_loss: 0.1961 - val_accuracy: 0.9378 Epoch 43/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2103 - accuracy: 0.9331 - val_loss: 0.2161 - val_accuracy: 0.9297 Epoch 44/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2158 - accuracy: 0.9310 - val_loss: 0.2258 - val_accuracy: 0.9307 Epoch 45/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2184 - accuracy: 0.9315 - val_loss: 0.2232 - val_accuracy: 0.9302 Epoch 46/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2144 - accuracy: 0.9316 - val_loss: 0.2183 - val_accuracy: 0.9315 Epoch 47/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2090 - accuracy: 0.9348 - val_loss: 0.2160 - val_accuracy: 0.9367 Epoch 48/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2075 - accuracy: 0.9334 - val_loss: 0.2165 - val_accuracy: 0.9292 Epoch 49/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1992 - accuracy: 0.9379 - val_loss: 0.2303 - val_accuracy: 0.9313 Epoch 50/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1963 - accuracy: 0.9382 - val_loss: 0.1864 - val_accuracy: 0.9423 Epoch 51/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1948 - accuracy: 0.9371 - val_loss: 0.2379 - val_accuracy: 0.9288 Epoch 52/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1953 - accuracy: 0.9384 - val_loss: 0.2168 - val_accuracy: 0.9338 Epoch 53/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2013 - accuracy: 0.9349 - val_loss: 0.2047 - val_accuracy: 0.9370 Epoch 54/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1936 - accuracy: 0.9384 - val_loss: 0.2352 - val_accuracy: 0.9245 Epoch 55/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2026 - accuracy: 0.9359 - val_loss: 0.2168 - val_accuracy: 0.9288 Epoch 56/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2005 - accuracy: 0.9374 - val_loss: 0.2173 - val_accuracy: 0.9327 Epoch 57/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2011 - accuracy: 0.9360 - val_loss: 0.2543 - val_accuracy: 0.9237 Epoch 58/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2032 - accuracy: 0.9353 - val_loss: 0.2188 - val_accuracy: 0.9345 Epoch 59/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1965 - accuracy: 0.9385 - val_loss: 0.2185 - val_accuracy: 0.9355 Epoch 60/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.1905 - accuracy: 0.9404 - val_loss: 0.2077 - val_accuracy: 0.9355 563/563 [==============================] - 1s 2ms/step - loss: 0.2265 - accuracy: 0.9304 Epoch 1/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.5166 - accuracy: 0.8349 - val_loss: 0.4035 - val_accuracy: 0.8687 Epoch 2/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3916 - accuracy: 0.8737 - val_loss: 0.3621 - val_accuracy: 0.8882 Epoch 3/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3606 - accuracy: 0.8833 - val_loss: 0.3224 - val_accuracy: 0.8985 Epoch 4/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3296 - accuracy: 0.8929 - val_loss: 0.3162 - val_accuracy: 0.9000 Epoch 5/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3235 - accuracy: 0.8968 - val_loss: 0.3010 - val_accuracy: 0.9060 Epoch 6/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3107 - accuracy: 0.8990 - val_loss: 0.3077 - val_accuracy: 0.8947 Epoch 7/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.3030 - accuracy: 0.9027 - val_loss: 0.3012 - val_accuracy: 0.9015 Epoch 8/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2822 - accuracy: 0.9106 - val_loss: 0.2443 - val_accuracy: 0.9245 Epoch 9/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2851 - accuracy: 0.9075 - val_loss: 0.2852 - val_accuracy: 0.9103 Epoch 10/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2861 - accuracy: 0.9092 - val_loss: 0.2800 - val_accuracy: 0.9123 Epoch 11/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2874 - accuracy: 0.9089 - val_loss: 0.2856 - val_accuracy: 0.9048 Epoch 12/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2895 - accuracy: 0.9070 - val_loss: 0.2811 - val_accuracy: 0.9092 Epoch 13/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2668 - accuracy: 0.9142 - val_loss: 0.2294 - val_accuracy: 0.9273 Epoch 14/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2460 - accuracy: 0.9205 - val_loss: 0.2309 - val_accuracy: 0.9310 Epoch 15/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2416 - accuracy: 0.9236 - val_loss: 0.2535 - val_accuracy: 0.9190 Epoch 16/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2351 - accuracy: 0.9235 - val_loss: 0.2215 - val_accuracy: 0.9312 Epoch 17/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2317 - accuracy: 0.9271 - val_loss: 0.2623 - val_accuracy: 0.9180 Epoch 18/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2323 - accuracy: 0.9263 - val_loss: 0.2913 - val_accuracy: 0.9087 Epoch 19/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2280 - accuracy: 0.9276 - val_loss: 0.2405 - val_accuracy: 0.9242 Epoch 20/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2226 - accuracy: 0.9302 - val_loss: 0.2238 - val_accuracy: 0.9283 Epoch 21/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2356 - accuracy: 0.9257 - val_loss: 0.2340 - val_accuracy: 0.9240 Epoch 22/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2259 - accuracy: 0.9274 - val_loss: 0.2232 - val_accuracy: 0.9333 Epoch 23/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2121 - accuracy: 0.9316 - val_loss: 0.2485 - val_accuracy: 0.9268 Epoch 24/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2120 - accuracy: 0.9326 - val_loss: 0.2460 - val_accuracy: 0.9247 Epoch 25/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2213 - accuracy: 0.9280 - val_loss: 0.2594 - val_accuracy: 0.9182 Epoch 26/100 1125/1125 [==============================] - 8s 7ms/step - loss: 0.2219 - accuracy: 0.9298 - val_loss: 0.2224 - val_accuracy: 0.9327 563/563 [==============================] - 1s 2ms/step - loss: 0.2331 - accuracy: 0.9268 Epoch 1/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.4841 - accuracy: 0.8462 - val_loss: 0.4213 - val_accuracy: 0.8670 Epoch 2/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3861 - accuracy: 0.8766 - val_loss: 0.3632 - val_accuracy: 0.8792 Epoch 3/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3427 - accuracy: 0.8896 - val_loss: 0.3122 - val_accuracy: 0.9023 Epoch 4/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3054 - accuracy: 0.9034 - val_loss: 0.2715 - val_accuracy: 0.9138 Epoch 5/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2899 - accuracy: 0.9073 - val_loss: 0.2547 - val_accuracy: 0.9200 Epoch 6/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2746 - accuracy: 0.9128 - val_loss: 0.3060 - val_accuracy: 0.9050 Epoch 7/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2615 - accuracy: 0.9185 - val_loss: 0.2511 - val_accuracy: 0.9242 Epoch 8/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2526 - accuracy: 0.9199 - val_loss: 0.2570 - val_accuracy: 0.9183 Epoch 9/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2378 - accuracy: 0.9245 - val_loss: 0.2401 - val_accuracy: 0.9253 Epoch 10/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2414 - accuracy: 0.9244 - val_loss: 0.2410 - val_accuracy: 0.9250 Epoch 11/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2362 - accuracy: 0.9237 - val_loss: 0.2379 - val_accuracy: 0.9263 Epoch 12/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2262 - accuracy: 0.9299 - val_loss: 0.2413 - val_accuracy: 0.9210 Epoch 13/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2274 - accuracy: 0.9278 - val_loss: 0.2113 - val_accuracy: 0.9360 Epoch 14/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2328 - accuracy: 0.9263 - val_loss: 0.2372 - val_accuracy: 0.9293 Epoch 15/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2108 - accuracy: 0.9333 - val_loss: 0.2019 - val_accuracy: 0.9378 Epoch 16/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2234 - accuracy: 0.9292 - val_loss: 0.2302 - val_accuracy: 0.9282 Epoch 17/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2202 - accuracy: 0.9289 - val_loss: 0.2485 - val_accuracy: 0.9222 Epoch 18/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2250 - accuracy: 0.9301 - val_loss: 0.2096 - val_accuracy: 0.9340 Epoch 19/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2117 - accuracy: 0.9322 - val_loss: 0.2081 - val_accuracy: 0.9368 Epoch 20/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2086 - accuracy: 0.9341 - val_loss: 0.1916 - val_accuracy: 0.9413 Epoch 21/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2076 - accuracy: 0.9346 - val_loss: 0.2259 - val_accuracy: 0.9310 Epoch 22/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1981 - accuracy: 0.9379 - val_loss: 0.1798 - val_accuracy: 0.9438 Epoch 23/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1998 - accuracy: 0.9374 - val_loss: 0.1933 - val_accuracy: 0.9417 Epoch 24/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2035 - accuracy: 0.9362 - val_loss: 0.2201 - val_accuracy: 0.9293 Epoch 25/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2136 - accuracy: 0.9324 - val_loss: 0.2127 - val_accuracy: 0.9377 Epoch 26/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1997 - accuracy: 0.9366 - val_loss: 0.2004 - val_accuracy: 0.9368 Epoch 27/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1949 - accuracy: 0.9382 - val_loss: 0.1980 - val_accuracy: 0.9378 Epoch 28/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1900 - accuracy: 0.9399 - val_loss: 0.1953 - val_accuracy: 0.9408 Epoch 29/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1941 - accuracy: 0.9388 - val_loss: 0.2016 - val_accuracy: 0.9378 Epoch 30/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1990 - accuracy: 0.9381 - val_loss: 0.1927 - val_accuracy: 0.9415 Epoch 31/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1864 - accuracy: 0.9422 - val_loss: 0.1923 - val_accuracy: 0.9415 Epoch 32/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1888 - accuracy: 0.9389 - val_loss: 0.2023 - val_accuracy: 0.9385 563/563 [==============================] - 1s 2ms/step - loss: 0.2004 - accuracy: 0.9387 Epoch 1/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.4941 - accuracy: 0.8408 - val_loss: 0.4875 - val_accuracy: 0.8393 Epoch 2/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3786 - accuracy: 0.8802 - val_loss: 0.3498 - val_accuracy: 0.8885 Epoch 3/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3234 - accuracy: 0.8973 - val_loss: 0.2808 - val_accuracy: 0.9102 Epoch 4/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2893 - accuracy: 0.9071 - val_loss: 0.2804 - val_accuracy: 0.9130 Epoch 5/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2780 - accuracy: 0.9103 - val_loss: 0.2492 - val_accuracy: 0.9242 Epoch 6/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2681 - accuracy: 0.9144 - val_loss: 0.2735 - val_accuracy: 0.9138 Epoch 7/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2610 - accuracy: 0.9166 - val_loss: 0.2337 - val_accuracy: 0.9267 Epoch 8/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2471 - accuracy: 0.9204 - val_loss: 0.2505 - val_accuracy: 0.9213 Epoch 9/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2333 - accuracy: 0.9268 - val_loss: 0.2559 - val_accuracy: 0.9203 Epoch 10/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2353 - accuracy: 0.9252 - val_loss: 0.2362 - val_accuracy: 0.9250 Epoch 11/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2269 - accuracy: 0.9277 - val_loss: 0.2151 - val_accuracy: 0.9343 Epoch 12/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2235 - accuracy: 0.9289 - val_loss: 0.2381 - val_accuracy: 0.9247 Epoch 13/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2142 - accuracy: 0.9322 - val_loss: 0.2269 - val_accuracy: 0.9295 Epoch 14/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2091 - accuracy: 0.9339 - val_loss: 0.2317 - val_accuracy: 0.9243 Epoch 15/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1988 - accuracy: 0.9365 - val_loss: 0.1963 - val_accuracy: 0.9417 Epoch 16/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1961 - accuracy: 0.9364 - val_loss: 0.1989 - val_accuracy: 0.9380 Epoch 17/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1923 - accuracy: 0.9388 - val_loss: 0.2327 - val_accuracy: 0.9250 Epoch 18/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1966 - accuracy: 0.9387 - val_loss: 0.2201 - val_accuracy: 0.9357 Epoch 19/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1892 - accuracy: 0.9396 - val_loss: 0.1866 - val_accuracy: 0.9462 Epoch 20/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1823 - accuracy: 0.9416 - val_loss: 0.1855 - val_accuracy: 0.9435 Epoch 21/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1860 - accuracy: 0.9412 - val_loss: 0.1991 - val_accuracy: 0.9382 Epoch 22/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1830 - accuracy: 0.9417 - val_loss: 0.2005 - val_accuracy: 0.9408 Epoch 23/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1759 - accuracy: 0.9450 - val_loss: 0.1892 - val_accuracy: 0.9435 Epoch 24/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1788 - accuracy: 0.9426 - val_loss: 0.2085 - val_accuracy: 0.9322 Epoch 25/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1827 - accuracy: 0.9413 - val_loss: 0.1983 - val_accuracy: 0.9363 Epoch 26/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1793 - accuracy: 0.9425 - val_loss: 0.1841 - val_accuracy: 0.9443 Epoch 27/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1776 - accuracy: 0.9444 - val_loss: 0.1804 - val_accuracy: 0.9438 Epoch 28/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1695 - accuracy: 0.9460 - val_loss: 0.1753 - val_accuracy: 0.9492 Epoch 29/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1747 - accuracy: 0.9447 - val_loss: 0.1833 - val_accuracy: 0.9422 Epoch 30/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1765 - accuracy: 0.9436 - val_loss: 0.1780 - val_accuracy: 0.9462 Epoch 31/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1728 - accuracy: 0.9450 - val_loss: 0.1851 - val_accuracy: 0.9463 Epoch 32/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1804 - accuracy: 0.9435 - val_loss: 0.1755 - val_accuracy: 0.9468 Epoch 33/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1667 - accuracy: 0.9476 - val_loss: 0.1764 - val_accuracy: 0.9462 Epoch 34/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1806 - accuracy: 0.9433 - val_loss: 0.1941 - val_accuracy: 0.9405 Epoch 35/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1726 - accuracy: 0.9457 - val_loss: 0.1762 - val_accuracy: 0.9437 Epoch 36/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1726 - accuracy: 0.9451 - val_loss: 0.1687 - val_accuracy: 0.9497 Epoch 37/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1633 - accuracy: 0.9481 - val_loss: 0.1938 - val_accuracy: 0.9397 Epoch 38/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1661 - accuracy: 0.9465 - val_loss: 0.1730 - val_accuracy: 0.9453 Epoch 39/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1675 - accuracy: 0.9464 - val_loss: 0.1990 - val_accuracy: 0.9397 Epoch 40/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1681 - accuracy: 0.9467 - val_loss: 0.1816 - val_accuracy: 0.9428 Epoch 41/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1622 - accuracy: 0.9484 - val_loss: 0.1763 - val_accuracy: 0.9472 Epoch 42/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1630 - accuracy: 0.9492 - val_loss: 0.1602 - val_accuracy: 0.9490 Epoch 43/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1639 - accuracy: 0.9485 - val_loss: 0.1762 - val_accuracy: 0.9453 Epoch 44/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1674 - accuracy: 0.9478 - val_loss: 0.1828 - val_accuracy: 0.9443 Epoch 45/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1547 - accuracy: 0.9498 - val_loss: 0.1881 - val_accuracy: 0.9402 Epoch 46/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1590 - accuracy: 0.9496 - val_loss: 0.1757 - val_accuracy: 0.9453 Epoch 47/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1592 - accuracy: 0.9490 - val_loss: 0.1799 - val_accuracy: 0.9462 Epoch 48/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1618 - accuracy: 0.9495 - val_loss: 0.1707 - val_accuracy: 0.9487 Epoch 49/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1576 - accuracy: 0.9499 - val_loss: 0.1765 - val_accuracy: 0.9478 Epoch 50/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1622 - accuracy: 0.9483 - val_loss: 0.2030 - val_accuracy: 0.9430 Epoch 51/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1607 - accuracy: 0.9500 - val_loss: 0.1697 - val_accuracy: 0.9495 Epoch 52/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1554 - accuracy: 0.9512 - val_loss: 0.1744 - val_accuracy: 0.9470 563/563 [==============================] - 1s 2ms/step - loss: 0.1839 - accuracy: 0.9431 Epoch 1/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.4794 - accuracy: 0.8478 - val_loss: 0.3462 - val_accuracy: 0.8853 Epoch 2/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3826 - accuracy: 0.8781 - val_loss: 0.3032 - val_accuracy: 0.9072 Epoch 3/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.3248 - accuracy: 0.8958 - val_loss: 0.3035 - val_accuracy: 0.9055 Epoch 4/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2938 - accuracy: 0.9060 - val_loss: 0.2755 - val_accuracy: 0.9120 Epoch 5/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2760 - accuracy: 0.9127 - val_loss: 0.2714 - val_accuracy: 0.9158 Epoch 6/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2693 - accuracy: 0.9143 - val_loss: 0.2709 - val_accuracy: 0.9113 Epoch 7/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2530 - accuracy: 0.9191 - val_loss: 0.2317 - val_accuracy: 0.9258 Epoch 8/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2571 - accuracy: 0.9203 - val_loss: 0.2411 - val_accuracy: 0.9198 Epoch 9/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2413 - accuracy: 0.9241 - val_loss: 0.2441 - val_accuracy: 0.9232 Epoch 10/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2450 - accuracy: 0.9213 - val_loss: 0.2296 - val_accuracy: 0.9303 Epoch 11/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2321 - accuracy: 0.9269 - val_loss: 0.2526 - val_accuracy: 0.9232 Epoch 12/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2241 - accuracy: 0.9291 - val_loss: 0.2297 - val_accuracy: 0.9267 Epoch 13/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2165 - accuracy: 0.9307 - val_loss: 0.2203 - val_accuracy: 0.9337 Epoch 14/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2160 - accuracy: 0.9324 - val_loss: 0.2229 - val_accuracy: 0.9337 Epoch 15/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2064 - accuracy: 0.9356 - val_loss: 0.2019 - val_accuracy: 0.9385 Epoch 16/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2085 - accuracy: 0.9360 - val_loss: 0.2078 - val_accuracy: 0.9353 Epoch 17/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1940 - accuracy: 0.9390 - val_loss: 0.2008 - val_accuracy: 0.9383 Epoch 18/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1933 - accuracy: 0.9386 - val_loss: 0.2037 - val_accuracy: 0.9385 Epoch 19/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1934 - accuracy: 0.9388 - val_loss: 0.2069 - val_accuracy: 0.9347 Epoch 20/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1927 - accuracy: 0.9389 - val_loss: 0.2325 - val_accuracy: 0.9275 Epoch 21/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.2000 - accuracy: 0.9378 - val_loss: 0.2051 - val_accuracy: 0.9378 Epoch 22/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1971 - accuracy: 0.9388 - val_loss: 0.1796 - val_accuracy: 0.9443 Epoch 23/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1896 - accuracy: 0.9404 - val_loss: 0.2007 - val_accuracy: 0.9395 Epoch 24/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1893 - accuracy: 0.9401 - val_loss: 0.1870 - val_accuracy: 0.9415 Epoch 25/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1902 - accuracy: 0.9397 - val_loss: 0.1977 - val_accuracy: 0.9400 Epoch 26/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1876 - accuracy: 0.9407 - val_loss: 0.2300 - val_accuracy: 0.9322 Epoch 27/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1841 - accuracy: 0.9419 - val_loss: 0.2054 - val_accuracy: 0.9377 Epoch 28/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1769 - accuracy: 0.9439 - val_loss: 0.1990 - val_accuracy: 0.9387 Epoch 29/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1777 - accuracy: 0.9443 - val_loss: 0.1932 - val_accuracy: 0.9380 Epoch 30/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1745 - accuracy: 0.9454 - val_loss: 0.1819 - val_accuracy: 0.9410 Epoch 31/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1820 - accuracy: 0.9425 - val_loss: 0.1873 - val_accuracy: 0.9377 Epoch 32/100 1125/1125 [==============================] - 6s 5ms/step - loss: 0.1819 - accuracy: 0.9434 - val_loss: 0.1865 - val_accuracy: 0.9423 563/563 [==============================] - 1s 2ms/step - loss: 0.2018 - accuracy: 0.9384 Epoch 1/100 1688/1688 [==============================] - 12s 7ms/step - loss: 0.6578 - accuracy: 0.8965 - val_loss: 0.1906 - val_accuracy: 0.9477 Epoch 2/100 1688/1688 [==============================] - 11s 7ms/step - loss: 0.1888 - accuracy: 0.9464 - val_loss: 0.1601 - val_accuracy: 0.9560 Epoch 3/100 1688/1688 [==============================] - 11s 7ms/step - loss: 0.1474 - accuracy: 0.9595 - val_loss: 0.1429 - val_accuracy: 0.9577 Epoch 4/100 1688/1688 [==============================] - 11s 7ms/step - loss: 0.1254 - accuracy: 0.9647 - val_loss: 0.1161 - val_accuracy: 0.9693 Epoch 5/100 1688/1688 [==============================] - 11s 7ms/step - loss: 0.1143 - accuracy: 0.9686 - val_loss: 0.1240 - val_accuracy: 0.9677 Epoch 6/100 1688/1688 [==============================] - 12s 7ms/step - loss: 0.0993 - accuracy: 0.9733 - val_loss: 0.1233 - val_accuracy: 0.9707 Epoch 7/100 1688/1688 [==============================] - 12s 7ms/step - loss: 0.0911 - accuracy: 0.9764 - val_loss: 0.1383 - val_accuracy: 0.9652 Epoch 8/100 1688/1688 [==============================] - 11s 7ms/step - loss: 0.0834 - accuracy: 0.9779 - val_loss: 0.1217 - val_accuracy: 0.9715 Epoch 9/100 1688/1688 [==============================] - 11s 7ms/step - loss: 0.0797 - accuracy: 0.9796 - val_loss: 0.1357 - val_accuracy: 0.9710 Epoch 10/100 1688/1688 [==============================] - 11s 7ms/step - loss: 0.0728 - accuracy: 0.9816 - val_loss: 0.1438 - val_accuracy: 0.9722 Epoch 11/100 1688/1688 [==============================] - 12s 7ms/step - loss: 0.0595 - accuracy: 0.9849 - val_loss: 0.1406 - val_accuracy: 0.9650 Epoch 12/100 1688/1688 [==============================] - 11s 7ms/step - loss: 0.0702 - accuracy: 0.9838 - val_loss: 0.1369 - val_accuracy: 0.9758 Epoch 13/100 1688/1688 [==============================] - 12s 7ms/step - loss: 0.0598 - accuracy: 0.9853 - val_loss: 0.1317 - val_accuracy: 0.9772 Epoch 14/100 1688/1688 [==============================] - 12s 7ms/step - loss: 0.0582 - accuracy: 0.9863 - val_loss: 0.1450 - val_accuracy: 0.9743 Time to optimize: 6494.0167760849
See top of page 322.
rnd_search_cv.best_params_
{'n_neurons': 300, 'n_hidden': 4, 'activation': 'relu'}
rnd_search_cv.best_score_
0.9732592503229777
task4_best_model = rnd_search_cv.best_estimator_.model
task4_best_model.save('task4_best_model.h5')
You should provide:
model = build_model(n_hidden=4,n_neurons=300,activation='relu')
callbacks = [keras.callbacks.EarlyStopping(monitor='val_loss', patience=10)]
history = model.fit(train_images_temp,train_labels_cat_temp,epochs=100,batch_size=128,
callbacks=callbacks,
validation_data=(val_images,val_labels_cat))
#model.save('fullytrained_task4_best_model.h5')
training_vals_acc = history.history['accuracy']
training_vals_loss = history.history['loss']
valid_vals_acc = history.history['val_accuracy']
valid_vals_loss = history.history['val_loss']
iterations = len(training_vals_acc)
print("Number of iterations:",iterations)
print("Epoch\t Train Loss\t Train Acc\t Val Loss\t Val Acc")
i = 0
for tl,ta,vl,va in zip(training_vals_loss,training_vals_acc,valid_vals_loss,valid_vals_acc):
print(i,'\t',round(tl,5),'\t',round(ta,5),'\t',round(vl,5),'\t',round(va,5))
i += 1
Epoch 1/100 422/422 [==============================] - 5s 9ms/step - loss: 1.1804 - accuracy: 0.8797 - val_loss: 0.2119 - val_accuracy: 0.9412 Epoch 2/100 422/422 [==============================] - 3s 8ms/step - loss: 0.1611 - accuracy: 0.9541 - val_loss: 0.1831 - val_accuracy: 0.9453 Epoch 3/100 422/422 [==============================] - 4s 8ms/step - loss: 0.1122 - accuracy: 0.9664 - val_loss: 0.1842 - val_accuracy: 0.9517 Epoch 4/100 422/422 [==============================] - 4s 9ms/step - loss: 0.0943 - accuracy: 0.9715 - val_loss: 0.1514 - val_accuracy: 0.9592 Epoch 5/100 422/422 [==============================] - 4s 9ms/step - loss: 0.0833 - accuracy: 0.9750 - val_loss: 0.1502 - val_accuracy: 0.9588 Epoch 6/100 422/422 [==============================] - 4s 8ms/step - loss: 0.0763 - accuracy: 0.9774 - val_loss: 0.1776 - val_accuracy: 0.9597 Epoch 7/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0796 - accuracy: 0.9765 - val_loss: 0.1654 - val_accuracy: 0.9615 Epoch 8/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0729 - accuracy: 0.9783 - val_loss: 0.1333 - val_accuracy: 0.9675 Epoch 9/100 422/422 [==============================] - 4s 9ms/step - loss: 0.0621 - accuracy: 0.9818 - val_loss: 0.1480 - val_accuracy: 0.9658 Epoch 10/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0613 - accuracy: 0.9824 - val_loss: 0.1637 - val_accuracy: 0.9627 Epoch 11/100 422/422 [==============================] - 4s 9ms/step - loss: 0.0539 - accuracy: 0.9839 - val_loss: 0.1622 - val_accuracy: 0.9647 Epoch 12/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0546 - accuracy: 0.9841 - val_loss: 0.1326 - val_accuracy: 0.9677 Epoch 13/100 422/422 [==============================] - 4s 9ms/step - loss: 0.0517 - accuracy: 0.9849 - val_loss: 0.1043 - val_accuracy: 0.9742 Epoch 14/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0449 - accuracy: 0.9871 - val_loss: 0.1203 - val_accuracy: 0.9717 Epoch 15/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0367 - accuracy: 0.9892 - val_loss: 0.1240 - val_accuracy: 0.9718 Epoch 16/100 422/422 [==============================] - 4s 9ms/step - loss: 0.0416 - accuracy: 0.9877 - val_loss: 0.1204 - val_accuracy: 0.9733 Epoch 17/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0430 - accuracy: 0.9874 - val_loss: 0.1507 - val_accuracy: 0.9660 Epoch 18/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0416 - accuracy: 0.9878 - val_loss: 0.1250 - val_accuracy: 0.9730 Epoch 19/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0348 - accuracy: 0.9899 - val_loss: 0.1073 - val_accuracy: 0.9782 Epoch 20/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0299 - accuracy: 0.9917 - val_loss: 0.1414 - val_accuracy: 0.9732 Epoch 21/100 422/422 [==============================] - 3s 8ms/step - loss: 0.0358 - accuracy: 0.9904 - val_loss: 0.1366 - val_accuracy: 0.9722 Epoch 22/100 422/422 [==============================] - 4s 8ms/step - loss: 0.0291 - accuracy: 0.9915 - val_loss: 0.1133 - val_accuracy: 0.9760 Epoch 23/100 422/422 [==============================] - 4s 8ms/step - loss: 0.0329 - accuracy: 0.9909 - val_loss: 0.1460 - val_accuracy: 0.9745 Number of iterations: 23 Epoch Train Loss Train Acc Val Loss Val Acc 0 1.18045 0.8797 0.2119 0.94117 1 0.16113 0.95407 0.1831 0.94533 2 0.11216 0.96637 0.18421 0.95167 3 0.09427 0.97146 0.15136 0.95917 4 0.0833 0.97502 0.15017 0.95883 5 0.0763 0.97737 0.17765 0.95967 6 0.07965 0.97652 0.1654 0.9615 7 0.07293 0.97826 0.13325 0.9675 8 0.06214 0.98181 0.14801 0.96583 9 0.06134 0.98237 0.16371 0.96267 10 0.05386 0.98389 0.16222 0.96467 11 0.05455 0.98407 0.13265 0.96767 12 0.05169 0.98485 0.10428 0.97417 13 0.04485 0.98711 0.12027 0.97167 14 0.03666 0.98922 0.12403 0.97183 15 0.04162 0.98767 0.12039 0.97333 16 0.04298 0.98741 0.15073 0.966 17 0.04158 0.98781 0.12504 0.973 18 0.03477 0.98994 0.10727 0.97817 19 0.02985 0.99174 0.14135 0.97317 20 0.03577 0.99035 0.13663 0.97217 21 0.02907 0.99148 0.11327 0.976 22 0.0329 0.99094 0.14601 0.9745
# MAKE A DATAFRAME OF RESULTS TO DISPLAY AND PLOT
df = pd.DataFrame()
df['iteration'] = range(0,iterations)
df['accuracy'] = history.history['accuracy']
df['loss'] = history.history['loss']
df['val_accuracy'] = history.history['val_accuracy']
df['val_loss'] = history.history['val_loss']
display(df.style)
| iteration | accuracy | loss | val_accuracy | val_loss | |
|---|---|---|---|---|---|
| 0 | 0 | 0.879704 | 1.180448 | 0.941167 | 0.211905 |
| 1 | 1 | 0.954074 | 0.161129 | 0.945333 | 0.183096 |
| 2 | 2 | 0.966370 | 0.112164 | 0.951667 | 0.184215 |
| 3 | 3 | 0.971463 | 0.094271 | 0.959167 | 0.151362 |
| 4 | 4 | 0.975019 | 0.083302 | 0.958833 | 0.150165 |
| 5 | 5 | 0.977370 | 0.076295 | 0.959667 | 0.177650 |
| 6 | 6 | 0.976519 | 0.079645 | 0.961500 | 0.165402 |
| 7 | 7 | 0.978259 | 0.072934 | 0.967500 | 0.133251 |
| 8 | 8 | 0.981815 | 0.062142 | 0.965833 | 0.148010 |
| 9 | 9 | 0.982370 | 0.061343 | 0.962667 | 0.163709 |
| 10 | 10 | 0.983889 | 0.053864 | 0.964667 | 0.162223 |
| 11 | 11 | 0.984074 | 0.054554 | 0.967667 | 0.132648 |
| 12 | 12 | 0.984852 | 0.051686 | 0.974167 | 0.104280 |
| 13 | 13 | 0.987111 | 0.044852 | 0.971667 | 0.120271 |
| 14 | 14 | 0.989222 | 0.036663 | 0.971833 | 0.124029 |
| 15 | 15 | 0.987667 | 0.041624 | 0.973333 | 0.120388 |
| 16 | 16 | 0.987407 | 0.042984 | 0.966000 | 0.150728 |
| 17 | 17 | 0.987815 | 0.041581 | 0.973000 | 0.125037 |
| 18 | 18 | 0.989944 | 0.034775 | 0.978167 | 0.107270 |
| 19 | 19 | 0.991741 | 0.029851 | 0.973167 | 0.141352 |
| 20 | 20 | 0.990352 | 0.035770 | 0.972167 | 0.136634 |
| 21 | 21 | 0.991481 | 0.029074 | 0.976000 | 0.113265 |
| 22 | 22 | 0.990944 | 0.032902 | 0.974500 | 0.146010 |
# Accuracy
fig = px.line(df, x='iteration', y=['accuracy','val_accuracy'], title='Accuracy vs Iteration')
fig.show()
# Loss
fig = px.line(df, x='iteration', y=['loss','val_loss'], title='Loss vs Iteration')
fig.show()
# Get the overall performance for the test sample
test_loss, test_acc = model.evaluate(test_images,test_labels_cat)
print("Test sample loss: ",test_loss, "; Test sample accuracy: ",test_acc)
313/313 [==============================] - 1s 2ms/step - loss: 0.1689 - accuracy: 0.9691 Test sample loss: 0.1689331978559494 ; Test sample accuracy: 0.9690999984741211
# Get the confusion matrix
#I am confused on how to make this confusion matrix
confusion_matrix = nested_defaultdict(int,2)
predictions = model.predict(test_images)
probs = np.max(predictions,axis=1)
classes = np.argmax(predictions,axis=1)
for true,pred in zip(classes,test_labels):
confusion_matrix[true][pred] += 1
for trueClass in range(10):
print("True: ",trueClass,end="")
for predClass in range(10):
print("\t",confusion_matrix[trueClass][predClass],end="")
print()
print()
True: 0 968 6 9 1 2 5 4 1 5 1 True: 1 1 1113 0 0 0 0 2 2 0 3 True: 2 2 2 980 1 3 0 0 7 3 0 True: 3 0 3 18 989 0 7 0 10 7 5 True: 4 1 1 2 0 944 1 3 2 3 8 True: 5 1 0 0 6 0 851 2 0 0 1 True: 6 3 2 3 0 6 12 945 0 1 1 True: 7 1 1 5 3 1 2 0 968 3 3 True: 8 1 6 13 5 3 11 2 5 949 3 True: 9 2 1 2 5 23 3 0 33 3 984
We have used the "Sequential" Keras API to build the models we have used so far. This is the best approach to use when our models are simple, but if we want to build a complex model such as:
then we need to use the more flexible "Functional" Keras API.
The book has a short descriptiuon of how to do this on p. 308-312. You can also find a simple writeup of this [here] (https://towardsdatascience.com/3-ways-to-create-a-machine-learning-model-with-keras-and-tensorflow-2-0-de09323af4d3).
For the extra credit, I want you to implement the best model above using the functional API. Train it, and verify you get the same (or at least similar) performance on the test set. For the perfomrance you can just call model.evaluate (no plots needed for this).
train_images = train_images.reshape(60000, 784)
test_images = test_images.reshape(10000, 784)
train_images_temp,val_images,train_labels_cat_temp,val_labels_cat = train_test_split(train_images,train_labels_cat, test_size=0.1, random_state=42)
def build_model_functional(n_hidden=2,n_neurons=100,optimizer='adam',activation='tanh',learning_rate=3e-3,input_shape=[28,28]):
inputs = keras.layers.Input(shape=(784,))
for i in range(n_hidden):
if i == 0:
x = keras.layers.Dense(n_neurons,activation=activation)(inputs)
else:
x = keras.layers.Dense(n_neurons,activation=activation)(x)
outputs= keras.layers.Dense(10,activation='softmax')(x)
model = keras.models.Model(inputs=inputs,outputs=outputs)
model.compile(optimizer=optimizer,loss='categorical_crossentropy',metrics=['accuracy'])
print(model.summary())
return model
model = build_model_functional(n_hidden=4,n_neurons=300,activation='relu')
Model: "model_13" _________________________________________________________________ Layer (type) Output Shape Param # ================================================================= input_16 (InputLayer) [(None, 784)] 0 _________________________________________________________________ dense_71 (Dense) (None, 300) 235500 _________________________________________________________________ dense_72 (Dense) (None, 300) 90300 _________________________________________________________________ dense_73 (Dense) (None, 300) 90300 _________________________________________________________________ dense_74 (Dense) (None, 300) 90300 _________________________________________________________________ dense_75 (Dense) (None, 10) 3010 ================================================================= Total params: 509,410 Trainable params: 509,410 Non-trainable params: 0 _________________________________________________________________ None
callbacks = [keras.callbacks.EarlyStopping(monitor='val_loss', patience=10)]
history = model.fit(train_images_temp,train_labels_cat_temp,epochs=100,batch_size=128,
callbacks=callbacks,
validation_data=(val_images,val_labels_cat))
#model.save('fullytrained_task4_best_model.h5')
training_vals_acc = history.history['accuracy']
training_vals_loss = history.history['loss']
valid_vals_acc = history.history['val_accuracy']
valid_vals_loss = history.history['val_loss']
iterations = len(training_vals_acc)
print("Number of iterations:",iterations)
print("Epoch\t Train Loss\t Train Acc\t Val Loss\t Val Acc")
i = 0
for tl,ta,vl,va in zip(training_vals_loss,training_vals_acc,valid_vals_loss,valid_vals_acc):
print(i,'\t',round(tl,5),'\t',round(ta,5),'\t',round(vl,5),'\t',round(va,5))
i += 1
Epoch 1/100 422/422 [==============================] - 3s 7ms/step - loss: 1.0134 - accuracy: 0.8831 - val_loss: 0.2033 - val_accuracy: 0.9430 Epoch 2/100 422/422 [==============================] - 3s 7ms/step - loss: 0.1678 - accuracy: 0.9521 - val_loss: 0.1557 - val_accuracy: 0.9558 Epoch 3/100 422/422 [==============================] - 3s 7ms/step - loss: 0.1169 - accuracy: 0.9652 - val_loss: 0.1659 - val_accuracy: 0.9567 Epoch 4/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0925 - accuracy: 0.9721 - val_loss: 0.1499 - val_accuracy: 0.9615 Epoch 5/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0909 - accuracy: 0.9729 - val_loss: 0.1602 - val_accuracy: 0.9605 Epoch 6/100 422/422 [==============================] - 3s 6ms/step - loss: 0.0799 - accuracy: 0.9763 - val_loss: 0.1328 - val_accuracy: 0.9655 Epoch 7/100 422/422 [==============================] - 3s 6ms/step - loss: 0.0684 - accuracy: 0.9798 - val_loss: 0.1463 - val_accuracy: 0.9673 Epoch 8/100 422/422 [==============================] - 3s 6ms/step - loss: 0.0636 - accuracy: 0.9806 - val_loss: 0.1402 - val_accuracy: 0.9653 Epoch 9/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0642 - accuracy: 0.9810 - val_loss: 0.1321 - val_accuracy: 0.9690 Epoch 10/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0601 - accuracy: 0.9823 - val_loss: 0.1273 - val_accuracy: 0.9713 Epoch 11/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0527 - accuracy: 0.9844 - val_loss: 0.1333 - val_accuracy: 0.9722 Epoch 12/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0492 - accuracy: 0.9857 - val_loss: 0.1168 - val_accuracy: 0.9747 Epoch 13/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0493 - accuracy: 0.9856 - val_loss: 0.1174 - val_accuracy: 0.9738 Epoch 14/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0410 - accuracy: 0.9880 - val_loss: 0.1203 - val_accuracy: 0.9708 Epoch 15/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0389 - accuracy: 0.9882 - val_loss: 0.1252 - val_accuracy: 0.9718 Epoch 16/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0420 - accuracy: 0.9880 - val_loss: 0.1091 - val_accuracy: 0.9770 Epoch 17/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0388 - accuracy: 0.9884 - val_loss: 0.1167 - val_accuracy: 0.9747 Epoch 18/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0364 - accuracy: 0.9895 - val_loss: 0.1320 - val_accuracy: 0.9740 Epoch 19/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0332 - accuracy: 0.9906 - val_loss: 0.1222 - val_accuracy: 0.9745 Epoch 20/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0385 - accuracy: 0.9888 - val_loss: 0.1475 - val_accuracy: 0.9717 Epoch 21/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0376 - accuracy: 0.9901 - val_loss: 0.1259 - val_accuracy: 0.9757 Epoch 22/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0304 - accuracy: 0.9919 - val_loss: 0.1112 - val_accuracy: 0.9763 Epoch 23/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0312 - accuracy: 0.9916 - val_loss: 0.1157 - val_accuracy: 0.9772 Epoch 24/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0258 - accuracy: 0.9930 - val_loss: 0.1179 - val_accuracy: 0.9758 Epoch 25/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0307 - accuracy: 0.9917 - val_loss: 0.1246 - val_accuracy: 0.9788 Epoch 26/100 422/422 [==============================] - 3s 7ms/step - loss: 0.0231 - accuracy: 0.9936 - val_loss: 0.1162 - val_accuracy: 0.9768 Number of iterations: 26 Epoch Train Loss Train Acc Val Loss Val Acc 0 1.01338 0.88307 0.20333 0.943 1 0.16776 0.95207 0.15574 0.95583 2 0.11688 0.96519 0.16593 0.95667 3 0.0925 0.97206 0.1499 0.9615 4 0.09094 0.97291 0.16021 0.9605 5 0.07995 0.97631 0.13285 0.9655 6 0.06842 0.97981 0.14634 0.96733 7 0.0636 0.98057 0.14018 0.96533 8 0.06423 0.98096 0.13215 0.969 9 0.06013 0.9823 0.12734 0.97133 10 0.05267 0.98441 0.13331 0.97217 11 0.04915 0.98569 0.11679 0.97467 12 0.04927 0.98565 0.11741 0.97383 13 0.04102 0.98796 0.12035 0.97083 14 0.03887 0.9882 0.12518 0.97183 15 0.04204 0.988 0.10915 0.977 16 0.03879 0.98843 0.11669 0.97467 17 0.03639 0.98948 0.13198 0.974 18 0.03321 0.99065 0.12224 0.9745 19 0.0385 0.98876 0.1475 0.97167 20 0.03759 0.99013 0.1259 0.97567 21 0.03042 0.99193 0.11119 0.97633 22 0.0312 0.99161 0.11567 0.97717 23 0.02579 0.99298 0.11791 0.97583 24 0.03075 0.99172 0.12455 0.97883 25 0.0231 0.99361 0.11618 0.97683
# Get the overall performance for the test sample
test_loss, test_acc = model.evaluate(test_images,test_labels_cat)
print("Test sample loss: ",test_loss, "; Test sample accuracy: ",test_acc)
313/313 [==============================] - 0s 1ms/step - loss: 0.1354 - accuracy: 0.9742 Test sample loss: 0.13535849750041962 ; Test sample accuracy: 0.9742000102996826
For the sequential model, I got a test accuracy of 0.969
For the Functional model, I got a test accuracy of 0.974